[ 525.167036] env[65231]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.167036] env[65231]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.175395] env[65319]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.175395] env[65319]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.760130] env[65319]: INFO neutron.common.config [-] Logging enabled! [ 527.760590] env[65319]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev39 [ 527.760654] env[65319]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65319) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 527.760922] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 527.761022] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 527.761849] env[65319]: WARNING oslo_policy.policy [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.762076] env[65319]: WARNING oslo_policy.policy [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.763743] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] VMware NSXv3 Agent initialized successfully. [ 527.764112] env[65319]: DEBUG oslo_concurrency.lockutils [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Acquiring lock "singleton_lock" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.764253] env[65319]: DEBUG oslo_concurrency.lockutils [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Acquired lock "singleton_lock" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.764443] env[65319]: DEBUG oslo_concurrency.lockutils [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Releasing lock "singleton_lock" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.764731] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Full set of CONF: {{(pid=65319) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 527.764838] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ******************************************************************************** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 527.764937] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Configuration options gathered from: {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 527.765300] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 527.765462] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 527.765555] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ================================================================================ {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 527.765720] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] agent_down_time = 75 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.765851] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] allow_automatic_dhcp_failover = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.765986] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] allow_bulk = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766137] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] api_extensions_path = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766273] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] api_paste_config = api-paste.ini {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766408] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] auth_strategy = keystone {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766511] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] backdoor_port = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766611] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] backdoor_socket = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766813] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] backlog = 4096 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.766903] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] base_mac = fa:16:3e:00:00:00 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767046] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] bind_host = 0.0.0.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767187] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] bind_port = 9696 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767318] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] client_socket_timeout = 900 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767449] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] config_dir = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767553] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767684] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] config_source = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767816] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] control_exchange = neutron {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.767951] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] core_plugin = ml2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768095] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] debug = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768232] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] default_availability_zones = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768434] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768567] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dhcp_agent_notification = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768697] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dhcp_agents_per_network = 1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768825] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dhcp_lease_duration = 86400 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.768969] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dhcp_load_type = networks {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769101] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dns_domain = openstacklocal {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769234] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769359] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_default_route_bfd = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769482] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_default_route_ecmp = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769606] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_dvr = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769726] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_new_agents = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769848] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.769972] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_signals = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770109] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] enable_traditional_dhcp = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770229] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] external_dns_driver = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770352] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] filter_validation = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770486] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] global_physnet_mtu = 8950 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770609] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] graceful_shutdown_timeout = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770782] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] host = cpu-1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.770917] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] host_dvr_for_dhcp = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771054] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] http_retries = 3 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771190] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] instance_format = [instance: %(uuid)s] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771319] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771446] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ipam_driver = internal {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771568] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ipv6_pd_enabled = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771748] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] l3_ha = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771817] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.771941] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] l3_ha_network_physical_name = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772082] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] l3_ha_network_type = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772217] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_color = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772344] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_config_append = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772474] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772601] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_dir = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772725] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_file = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772824] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_options = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.772955] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_rotate_interval = 1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773098] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_rotate_interval_type = days {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773229] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] log_rotation_type = none {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773328] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773425] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773556] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773685] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773783] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.773910] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_dns_nameservers = 5 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774054] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_header_line = 16384 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774183] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_l3_agents_per_router = 3 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774306] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_logfile_count = 30 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774428] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_logfile_size_mb = 200 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774552] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] max_subnet_host_routes = 20 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774681] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] my_ip = 10.180.1.21 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774810] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] my_ipv6 = ::1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.774937] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] network_auto_schedule = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775071] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] network_link_prefix = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775202] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775336] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] notify_nova_on_port_data_changes = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775466] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] notify_nova_on_port_status_changes = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775599] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] pagination_max_limit = -1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775723] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] publish_errors = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775846] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rate_limit_burst = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.775978] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rate_limit_except_level = CRITICAL {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776118] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rate_limit_interval = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776243] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] retry_until_window = 30 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776367] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] router_distributed = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776492] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rpc_resources_processing_step = 20 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776615] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rpc_response_max_timeout = 600 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776742] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] rpc_response_timeout = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.776865] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] send_events_interval = 2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777016] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] service_plugins = ['router'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777159] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] setproctitle = on {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777283] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] shell_completion = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777414] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] state_path = /opt/stack/data/neutron {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777543] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] syslog_log_facility = LOG_USER {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777669] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] tcp_keepidle = 600 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777798] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] transport_url = **** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.777921] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] use_journal = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778055] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] use_json = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778179] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] use_ssl = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778299] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] use_stderr = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778428] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] use_syslog = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778550] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vlan_qinq = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778677] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vlan_transparent = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778801] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] watch_log_file = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.778927] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] wsgi_default_pool_size = 100 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.779063] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] wsgi_keep_alive = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.779199] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.779380] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] wsgi_server_debug = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.779473] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_concurrency.disable_process_locking = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.779614] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.779752] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.779890] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780036] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780176] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780310] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780456] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.connection_string = messaging:// {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780592] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.enabled = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780727] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.es_doc_type = notification {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780859] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.es_scroll_size = 10000 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.780993] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.es_scroll_time = 2m {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781136] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.filter_error_trace = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781270] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.hmac_keys = **** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781406] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.sentinel_service_name = mymaster {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781541] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.socket_timeout = 0.1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781669] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.trace_requests = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781796] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler.trace_sqlalchemy = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.781933] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler_jaeger.process_tags = {} {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.782070] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler_jaeger.service_name_prefix = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.782204] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] profiler_otlp.service_name_prefix = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.782347] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.enforce_new_defaults = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.782617] env[65319]: WARNING oslo_config.cfg [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 527.782764] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.enforce_scope = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.782932] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.policy_default_rule = default {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783072] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783213] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783351] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783481] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783610] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783735] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783862] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.783999] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_policy.remote_timeout = 60.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784160] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784301] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] agent.extensions = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784438] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784574] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] service_providers.service_provider = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784715] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.default_quota = -1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784854] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.784987] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_floatingip = 50 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785129] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_network = 100 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785258] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_port = 500 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785387] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785514] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_router = 10 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785639] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_security_group = 10 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785767] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.785895] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.quota_subnet = 100 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786034] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] QUOTAS.track_quota_usage = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786180] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786308] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786433] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786562] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786694] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786823] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.786949] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787127] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787260] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787387] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787515] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787648] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787778] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.787906] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_dhcp_release.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788055] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788182] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788308] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788435] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788568] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788700] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788827] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_ovs_vsctl.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.788963] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.capabilities = [21] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789103] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789231] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789359] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789493] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789625] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789748] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_namespace.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.789883] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.capabilities = [12] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790014] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790148] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790278] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790410] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790541] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790667] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_conntrack.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790805] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.capabilities = [12, 21] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.790936] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.group = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791071] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.helper_command = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791201] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.log_daemon_traceback = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791334] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791463] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.thread_pool_size = 8 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791589] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] privsep_link.user = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791741] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.791886] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792075] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.continue_on_failed_promotions = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792160] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.dscp = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792293] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.dscp_inherit = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792431] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.force_mp_to_policy = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792564] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.locking_coordinator_url = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792696] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.log_agent_heartbeats = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792829] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.logging_expire = 1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.792970] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793119] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793262] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.polling_interval = 240 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793395] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793533] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793677] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.report_interval = 30.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793816] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.793956] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794109] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794249] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.sync_skew = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794385] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.synchronization_queue_size = 20 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794519] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT.use_helper_for_ns_read = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794662] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] SECURITYGROUP.enable_ipset = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794803] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] SECURITYGROUP.enable_security_group = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.794944] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795095] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795236] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] experimental.ipv6_pd_enabled = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795391] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.extension_drivers = ['port_security'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795522] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.external_network_type = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795667] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795806] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.overlay_ip_version = 4 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.795945] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.path_mtu = 8950 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796093] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.physical_network_mtus = {} {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796237] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.tenant_network_types = ['vlan'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796374] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796512] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ml2.type_drivers = ['vlan'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796653] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT_CLI.neutron_port_id = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796783] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.796913] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797067] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797210] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797346] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797482] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797618] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797756] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.797961] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798122] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_login_password = **** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798270] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_login_port = 443 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798406] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_login_user = admin {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798543] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798686] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798820] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.798952] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799104] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799248] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799386] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799524] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799662] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799803] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.799948] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800099] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800238] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800432] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800573] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vsphere.vsphere_login_password = VMware1! {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800711] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800845] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.800984] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.auth_section = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801139] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.auth_type = password {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801275] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801404] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.certfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801539] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.collect_timing = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801680] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.endpoint_type = public {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801810] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.insecure = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.801936] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.keyfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802101] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.region_name = RegionOne {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802243] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.split_loggers = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802366] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] nova.timeout = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802502] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.auth_section = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802643] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.auth_type = password {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802779] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.802931] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.certfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803060] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.collect_timing = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803199] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.endpoint_type = public {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803327] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.insecure = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803451] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.keyfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803574] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.region_name = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803701] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.split_loggers = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803822] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] placement.timeout = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.803959] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.auth_section = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804101] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.auth_type = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804230] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.cafile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804352] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.certfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804479] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.collect_timing = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804608] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.connect_retries = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804737] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.connect_retry_delay = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804866] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.enable_notifications = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.804992] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.endpoint_override = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805136] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.insecure = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805267] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.interface = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805394] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.keyfile = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805526] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.max_version = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805652] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.min_version = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805776] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.region_name = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.805903] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.retriable_status_codes = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806039] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.service_name = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806165] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.service_type = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806297] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.split_loggers = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806423] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.status_code_retries = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806551] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.status_code_retry_delay = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806680] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.timeout = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806809] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.valid_interfaces = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.806937] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ironic.version = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807087] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] cli_script.dry_run = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807233] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807366] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807499] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807629] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807760] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.807889] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808028] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808166] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808295] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808433] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808565] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808703] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808838] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.808973] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809119] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809258] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809388] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809519] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809657] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809790] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.809922] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810063] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810196] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810328] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810459] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810587] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810715] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810845] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.810975] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811116] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811247] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811382] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811515] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811644] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811777] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.811911] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.ssl_version = {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812052] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812192] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_notifications.driver = [] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812358] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_notifications.retry = -1 {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812468] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812596] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] oslo_messaging_notifications.transport_url = **** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.812698] env[65319]: DEBUG oslo_service.backend._eventlet.service [None req-c7f71edc-dcbe-473e-bfb8-6d70993da06b None None] ******************************************************************************** {{(pid=65319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 527.813859] env[65319]: DEBUG neutron.agent.securitygroups_rpc [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Init firewall settings (driver=nsxv3) {{(pid=65319) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 527.815200] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65319) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 527.815443] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] RPC agent_id: nsxm-l-01a.corp.local [ 527.817629] env[65319]: DEBUG dogpile.cache.region [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.817987] env[65319]: DEBUG dogpile.lock [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 527.817987] env[65319]: DEBUG dogpile.lock [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 527.817987] env[65319]: DEBUG dogpile.lock [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 527.818114] env[65319]: DEBUG dogpile.cache.region [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.818114] env[65319]: DEBUG dogpile.lock [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 527.818229] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 527.837755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Session token - acquiring [ 527.839343] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.839521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.839646] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.840084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.851702] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.143631] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 528.172053] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 528.172287] env[65319]: DEBUG dogpile.cache.region [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Cache value generated in 0.354 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 528.172349] env[65319]: DEBUG dogpile.lock [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 528.172446] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Activating Policy API Provider. [ 528.172648] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Looking for the default Infrastructure Rules. [ 528.239537] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Looking for the Default Layer3 Logged Drop Section. [ 528.256249] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 528.256715] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.256939] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.257263] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.257586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.257959] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.773203] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.275453] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.777929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Inventory metadata is going to be refreshed. [ 529.778398] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 530.603764] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.604021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.604100] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.604418] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.616815] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 530.617730] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.618410] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 530.637106] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.637395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.637395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.637671] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.637797] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.637942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 530.638073] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.638190] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 530.658449] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.658771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.658771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.658996] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.659214] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.659374] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 530.681083] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.681396] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.681396] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.681652] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.681850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.681942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 530.709528] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.709819] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.709819] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.710085] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.710233] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.710381] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 530.710486] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.710588] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 530.731081] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.731394] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.731394] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.731763] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.731763] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.732142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 530.732142] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.732142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 530.752682] env[65319]: DEBUG networking_nsxv3.common.locking [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.753061] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.753061] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.753374] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.753520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.753669] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 530.753771] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.753871] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Inventory metadata have been refreshed. [ 530.754094] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Dryrun:True. Metadata refresh completed. [ 530.754205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.755865] env[65319]: INFO neutron.agent.agent_extensions_manager [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Loaded agent extensions: [] [ 530.756584] env[65319]: DEBUG neutron_lib.callbacks.manager [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65319) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 530.810306] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent RPC Daemon Started! [ 530.810643] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:0 started [ 530.810643] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent out of sync with plugin! [ 535.757382] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.757382] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.758912] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.759327] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.760367] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.760716] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.784326] env[65319]: INFO networking_nsxv3.common.synchronization [None req-2b3f92d1-ef5e-47b5-b214-94efd864f801 demo admin] Enqueued Resource ID: cf9965c1-ec06-49aa-8dab-6641948f55bd with Priority: HIGHEST for action security_group_rules [ 545.784837] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf9965c1-ec06-49aa-8dab-6641948f55bd with Priority: HIGHEST for action security_group_rules [ 545.785157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf9965c1-ec06-49aa-8dab-6641948f55bd taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.785285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf9965c1-ec06-49aa-8dab-6641948f55bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.785421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf9965c1-ec06-49aa-8dab-6641948f55bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.785724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf9965c1-ec06-49aa-8dab-6641948f55bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.785811] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf9965c1-ec06-49aa-8dab-6641948f55bd',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.308222] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.308457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.308457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.308634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.308731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.308853] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf9965c1-ec06-49aa-8dab-6641948f55bd already deleted. [ 546.308920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf9965c1-ec06-49aa-8dab-6641948f55bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.786113] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.786113] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.787769] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.787769] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.788888] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.789257] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.790135] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.790572] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.792735] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.792735] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.606293] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b3d13b01-d8fe-42eb-a53b-3fca9887052f None None] Enqueued Resource ID: 21b1af99-728e-4485-b3ae-2c694a125234 with Priority: HIGHEST for action port [ 571.606293] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b1af99-728e-4485-b3ae-2c694a125234 with Priority: HIGHEST for action port [ 571.606438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-21b1af99-728e-4485-b3ae-2c694a125234 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.606506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21b1af99-728e-4485-b3ae-2c694a125234" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.607267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21b1af99-728e-4485-b3ae-2c694a125234" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.607267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21b1af99-728e-4485-b3ae-2c694a125234" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.607267] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21b1af99-728e-4485-b3ae-2c694a125234',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.109441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21b1af99-728e-4485-b3ae-2c694a125234 [ 572.109772] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.109772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.109892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.110066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.110131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.110241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21b1af99-728e-4485-b3ae-2c694a125234 already deleted. [ 572.110961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21b1af99-728e-4485-b3ae-2c694a125234" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.292213] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7013722a-c301-4132-93ca-6600f0746947 None None] Enqueued Resource ID: ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2 with Priority: HIGHEST for action port [ 573.292532] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2 with Priority: HIGHEST for action port [ 573.293051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.293214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.293358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.293525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.293608] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.796768] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2 [ 573.796768] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.796768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.796768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.796768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.796768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.796768] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2 already deleted. [ 573.796768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef16bb6a-a5a8-4bc0-8cd1-3a1d2a6c85f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.973335] env[65319]: INFO networking_nsxv3.common.synchronization [None req-026a7279-5719-420d-bacf-89e08d6e699f None None] Enqueued Resource ID: 0acfed24-4c7a-40e6-a67c-d3e9a4f85d15 with Priority: HIGHEST for action port [ 577.973335] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0acfed24-4c7a-40e6-a67c-d3e9a4f85d15 with Priority: HIGHEST for action port [ 577.973650] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-0acfed24-4c7a-40e6-a67c-d3e9a4f85d15 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.973650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0acfed24-4c7a-40e6-a67c-d3e9a4f85d15" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.973650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0acfed24-4c7a-40e6-a67c-d3e9a4f85d15" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.973892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0acfed24-4c7a-40e6-a67c-d3e9a4f85d15" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.973892] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acfed24-4c7a-40e6-a67c-d3e9a4f85d15',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.477953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0acfed24-4c7a-40e6-a67c-d3e9a4f85d15 [ 578.478215] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.478365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.478440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.478635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.478732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.478828] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0acfed24-4c7a-40e6-a67c-d3e9a4f85d15 already deleted. [ 578.478911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0acfed24-4c7a-40e6-a67c-d3e9a4f85d15" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.789664] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ae6c53ad-8dfe-4fbe-834a-60409b6fa297 None None] Enqueued Resource ID: 10b99cb0-3756-4a4c-9943-d697af14a97d with Priority: HIGHEST for action port [ 578.790271] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10b99cb0-3756-4a4c-9943-d697af14a97d with Priority: HIGHEST for action port [ 578.790857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-10b99cb0-3756-4a4c-9943-d697af14a97d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.790857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10b99cb0-3756-4a4c-9943-d697af14a97d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.790857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10b99cb0-3756-4a4c-9943-d697af14a97d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.791315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10b99cb0-3756-4a4c-9943-d697af14a97d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.791984] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10b99cb0-3756-4a4c-9943-d697af14a97d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.098305] env[65319]: INFO networking_nsxv3.common.synchronization [None req-989a48fd-0fb1-46ea-af50-03523deb9500 None None] Enqueued Resource ID: 6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd with Priority: HIGHEST for action port [ 579.101118] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd with Priority: HIGHEST for action port [ 579.101118] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.101118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.101118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.101118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.101118] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.295174] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10b99cb0-3756-4a4c-9943-d697af14a97d [ 579.295398] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.295541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.295607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.297037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.297037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.297037] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10b99cb0-3756-4a4c-9943-d697af14a97d already deleted. [ 579.297037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10b99cb0-3756-4a4c-9943-d697af14a97d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.603671] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd [ 579.604044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.604844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.604844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.604844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.604844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.604844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd already deleted. [ 579.605436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de2f2c6-d8fc-42f5-8fd1-ed278d4100bd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.108515] env[65319]: INFO networking_nsxv3.common.synchronization [None req-79f88e21-4822-458f-8191-bc0ce333e48b None None] Enqueued Resource ID: d15d43d0-6fa7-4b3e-a7be-7e9a92406180 with Priority: HIGHEST for action port [ 580.109622] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15d43d0-6fa7-4b3e-a7be-7e9a92406180 with Priority: HIGHEST for action port [ 580.112478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d15d43d0-6fa7-4b3e-a7be-7e9a92406180 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.112478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d15d43d0-6fa7-4b3e-a7be-7e9a92406180" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.112478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d15d43d0-6fa7-4b3e-a7be-7e9a92406180" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.112478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d15d43d0-6fa7-4b3e-a7be-7e9a92406180" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.112478] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d15d43d0-6fa7-4b3e-a7be-7e9a92406180',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.334350] env[65319]: INFO networking_nsxv3.common.synchronization [None req-fc7ed2e8-565f-445d-9f6c-7591e2798184 None None] Enqueued Resource ID: b60564ca-7e61-4410-bc10-d77bcdf98aa1 with Priority: HIGHEST for action port [ 580.334913] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60564ca-7e61-4410-bc10-d77bcdf98aa1 with Priority: HIGHEST for action port [ 580.335241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60564ca-7e61-4410-bc10-d77bcdf98aa1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.335728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60564ca-7e61-4410-bc10-d77bcdf98aa1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.335728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60564ca-7e61-4410-bc10-d77bcdf98aa1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.335728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60564ca-7e61-4410-bc10-d77bcdf98aa1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.335728] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60564ca-7e61-4410-bc10-d77bcdf98aa1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.615389] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d15d43d0-6fa7-4b3e-a7be-7e9a92406180 [ 580.615667] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.615810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.615880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.616123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.616192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.616288] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d15d43d0-6fa7-4b3e-a7be-7e9a92406180 already deleted. [ 580.616368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d15d43d0-6fa7-4b3e-a7be-7e9a92406180" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.838387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60564ca-7e61-4410-bc10-d77bcdf98aa1 [ 580.838612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.838747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.838813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.839039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.839124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.839217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60564ca-7e61-4410-bc10-d77bcdf98aa1 already deleted. [ 580.839306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60564ca-7e61-4410-bc10-d77bcdf98aa1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.040400] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8994115c-a5de-45d5-aa3e-df3293bf4be6 None None] Enqueued Resource ID: 56df8952-733c-4e69-8581-5cbe32a25a33 with Priority: HIGHEST for action port [ 581.040400] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56df8952-733c-4e69-8581-5cbe32a25a33 with Priority: HIGHEST for action port [ 581.040400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-56df8952-733c-4e69-8581-5cbe32a25a33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.040400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56df8952-733c-4e69-8581-5cbe32a25a33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.040400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56df8952-733c-4e69-8581-5cbe32a25a33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.040400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56df8952-733c-4e69-8581-5cbe32a25a33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.040400] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56df8952-733c-4e69-8581-5cbe32a25a33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.348206] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7f526df8-91bc-4a8e-81a4-38f8244273cc None None] Enqueued Resource ID: 58f84334-624a-4220-a44d-ebc5acaf642c with Priority: HIGHEST for action port [ 581.348206] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f84334-624a-4220-a44d-ebc5acaf642c with Priority: HIGHEST for action port [ 581.348206] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f84334-624a-4220-a44d-ebc5acaf642c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.348206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f84334-624a-4220-a44d-ebc5acaf642c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.348206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f84334-624a-4220-a44d-ebc5acaf642c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.348206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f84334-624a-4220-a44d-ebc5acaf642c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.348206] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f84334-624a-4220-a44d-ebc5acaf642c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.547531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56df8952-733c-4e69-8581-5cbe32a25a33 [ 581.547531] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.547531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.547771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.547819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.548530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.548530] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56df8952-733c-4e69-8581-5cbe32a25a33 already deleted. [ 581.548530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56df8952-733c-4e69-8581-5cbe32a25a33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.760478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.760596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.760653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.760858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.761600] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.853913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58f84334-624a-4220-a44d-ebc5acaf642c [ 581.854278] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.854428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.854500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.854730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.854818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.854913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58f84334-624a-4220-a44d-ebc5acaf642c already deleted. [ 581.854993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f84334-624a-4220-a44d-ebc5acaf642c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.263954] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.375685] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ecf90091-5738-4463-9625-64c8d8cd28ae None None] Enqueued Resource ID: 4f5afa8a-873f-44ed-8741-f33a7ddfe99c with Priority: HIGHEST for action port [ 582.377351] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5afa8a-873f-44ed-8741-f33a7ddfe99c with Priority: HIGHEST for action port [ 582.377726] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f5afa8a-873f-44ed-8741-f33a7ddfe99c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.380021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f5afa8a-873f-44ed-8741-f33a7ddfe99c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.380021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f5afa8a-873f-44ed-8741-f33a7ddfe99c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.380021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f5afa8a-873f-44ed-8741-f33a7ddfe99c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.380021] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f5afa8a-873f-44ed-8741-f33a7ddfe99c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.767978] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.880537] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f5afa8a-873f-44ed-8741-f33a7ddfe99c [ 582.880798] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.880961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.881019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.881241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.881346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.881440] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f5afa8a-873f-44ed-8741-f33a7ddfe99c already deleted. [ 582.882031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f5afa8a-873f-44ed-8741-f33a7ddfe99c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.273747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 583.273747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 583.484330] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b69c5e1f-c866-4442-9ae1-5449a53b9e14 None None] Enqueued Resource ID: 78bbf8f8-6a07-4276-aa9b-9ac1d07e224b with Priority: HIGHEST for action port [ 583.486501] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78bbf8f8-6a07-4276-aa9b-9ac1d07e224b with Priority: HIGHEST for action port [ 583.486501] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-78bbf8f8-6a07-4276-aa9b-9ac1d07e224b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.486501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78bbf8f8-6a07-4276-aa9b-9ac1d07e224b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.486501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78bbf8f8-6a07-4276-aa9b-9ac1d07e224b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.486501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78bbf8f8-6a07-4276-aa9b-9ac1d07e224b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.486501] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78bbf8f8-6a07-4276-aa9b-9ac1d07e224b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.993755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78bbf8f8-6a07-4276-aa9b-9ac1d07e224b [ 583.993755] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.993755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.993755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.993755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.993755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.993755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78bbf8f8-6a07-4276-aa9b-9ac1d07e224b already deleted. [ 583.993755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78bbf8f8-6a07-4276-aa9b-9ac1d07e224b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.074618] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.076781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.076781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.076781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.094921] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 584.098389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.099977] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 584.126913] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.127108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.127179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.127550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.127550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.127640] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 584.128265] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.128265] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 584.155254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.155794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.155794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.155794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.155945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.155945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.180875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.181041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.181151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.181355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.181471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.181603] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.204662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.205633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.205633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.205633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.205633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.205633] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 584.205633] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.206118] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 584.234344] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.234344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.234344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.234344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.234344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.234344] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 584.234344] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.234344] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 584.262708] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.262708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.262708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.262708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.262708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 584.262708] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 584.262708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.284797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.284945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.285028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.285244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.285356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.285459] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.308970] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.311312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.311312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.311312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.311312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.342315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.691201] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e9a205dd-5714-4515-8ba2-65814bd9c485 None None] Enqueued Resource ID: 842beecc-0931-4ee4-8843-0be7722b9032 with Priority: HIGHEST for action port [ 584.691636] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842beecc-0931-4ee4-8843-0be7722b9032 with Priority: HIGHEST for action port [ 584.691636] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-842beecc-0931-4ee4-8843-0be7722b9032 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.692021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842beecc-0931-4ee4-8843-0be7722b9032" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.692021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842beecc-0931-4ee4-8843-0be7722b9032" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.692151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842beecc-0931-4ee4-8843-0be7722b9032" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.692273] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842beecc-0931-4ee4-8843-0be7722b9032',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.195071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 842beecc-0931-4ee4-8843-0be7722b9032 [ 585.195195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.195302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.195357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.195580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.195694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.195801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:842beecc-0931-4ee4-8843-0be7722b9032 already deleted. [ 585.195874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842beecc-0931-4ee4-8843-0be7722b9032" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.814996] env[65319]: INFO networking_nsxv3.common.synchronization [None req-96d053d6-a79d-4562-b7b8-ed557e0e8041 None None] Enqueued Resource ID: c2670214-e5ea-4a23-ab4e-2c0df45b14d4 with Priority: HIGHEST for action port [ 585.815542] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2670214-e5ea-4a23-ab4e-2c0df45b14d4 with Priority: HIGHEST for action port [ 585.815848] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2670214-e5ea-4a23-ab4e-2c0df45b14d4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.815967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2670214-e5ea-4a23-ab4e-2c0df45b14d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.816852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2670214-e5ea-4a23-ab4e-2c0df45b14d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.816940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2670214-e5ea-4a23-ab4e-2c0df45b14d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.817029] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2670214-e5ea-4a23-ab4e-2c0df45b14d4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.320719] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2670214-e5ea-4a23-ab4e-2c0df45b14d4 [ 586.320943] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.321103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.321165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.321393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.321478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.321571] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2670214-e5ea-4a23-ab4e-2c0df45b14d4 already deleted. [ 586.321647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2670214-e5ea-4a23-ab4e-2c0df45b14d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.208541] env[65319]: INFO networking_nsxv3.common.synchronization [None req-41d6fa60-fe1e-4cee-8a73-88e596884cd5 None None] Enqueued Resource ID: a7d2221c-71a3-4c2e-a952-4e86a84856b1 with Priority: HIGHEST for action port [ 587.208838] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d2221c-71a3-4c2e-a952-4e86a84856b1 with Priority: HIGHEST for action port [ 587.209664] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d2221c-71a3-4c2e-a952-4e86a84856b1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.209834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d2221c-71a3-4c2e-a952-4e86a84856b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.209875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d2221c-71a3-4c2e-a952-4e86a84856b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.210498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d2221c-71a3-4c2e-a952-4e86a84856b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.210759] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d2221c-71a3-4c2e-a952-4e86a84856b1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.349452] env[65319]: INFO networking_nsxv3.common.synchronization [None req-72f4e3f1-afcd-4c33-9af0-9ca7e2af36b3 None None] Enqueued Resource ID: 8441f386-92ea-446c-bb03-f7f4baa76835 with Priority: HIGHEST for action port [ 587.350084] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8441f386-92ea-446c-bb03-f7f4baa76835 with Priority: HIGHEST for action port [ 587.350494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8441f386-92ea-446c-bb03-f7f4baa76835 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.350626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8441f386-92ea-446c-bb03-f7f4baa76835" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.350698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8441f386-92ea-446c-bb03-f7f4baa76835" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.350948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8441f386-92ea-446c-bb03-f7f4baa76835" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.351526] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8441f386-92ea-446c-bb03-f7f4baa76835',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.715466] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7d2221c-71a3-4c2e-a952-4e86a84856b1 [ 587.715466] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.715466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.715466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.715466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.715466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.715466] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7d2221c-71a3-4c2e-a952-4e86a84856b1 already deleted. [ 587.715466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d2221c-71a3-4c2e-a952-4e86a84856b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.853738] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8441f386-92ea-446c-bb03-f7f4baa76835 [ 587.853965] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.854178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.854178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.854508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.854612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.854705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8441f386-92ea-446c-bb03-f7f4baa76835 already deleted. [ 587.854789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8441f386-92ea-446c-bb03-f7f4baa76835" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.578525] env[65319]: INFO networking_nsxv3.common.synchronization [None req-fcbc0afb-93d9-461f-8de5-617a8661d4fd None None] Enqueued Resource ID: 016608c2-73f4-47e5-9860-7c9cae1682cf with Priority: HIGHEST for action port [ 588.578525] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 016608c2-73f4-47e5-9860-7c9cae1682cf with Priority: HIGHEST for action port [ 588.579056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-016608c2-73f4-47e5-9860-7c9cae1682cf taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.579056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-016608c2-73f4-47e5-9860-7c9cae1682cf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.579056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-016608c2-73f4-47e5-9860-7c9cae1682cf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.579256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-016608c2-73f4-47e5-9860-7c9cae1682cf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.579340] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('016608c2-73f4-47e5-9860-7c9cae1682cf',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.924086] env[65319]: INFO networking_nsxv3.common.synchronization [req-cc3d13b8-f7d0-418a-b2a3-4def8fcdde82 req-4bfcb0f0-e066-41b2-a0ef-736b0045e9a0 tempest-ServerDiagnosticsNegativeTest-1512392746 tempest-ServerDiagnosticsNegativeTest-1512392746-project-member] Enqueued Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 588.924846] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 588.924937] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.926709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.926709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.926709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.926709] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.927119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.927119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.927344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.927456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.927526] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.084880] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 016608c2-73f4-47e5-9860-7c9cae1682cf [ 589.084880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.084880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.084880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.084880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.084880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.084880] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:016608c2-73f4-47e5-9860-7c9cae1682cf already deleted. [ 589.084880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-016608c2-73f4-47e5-9860-7c9cae1682cf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.088546] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e99a33e3-74b0-4bbf-9833-2ca27dbfc304 tempest-ServersTestFqdnHostnames-1763966681 tempest-ServersTestFqdnHostnames-1763966681-project-member] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 589.088740] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 589.090167] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.090167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.090167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.090167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.090167] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.145380] env[65319]: INFO networking_nsxv3.common.synchronization [None req-9ca68cae-5c63-401f-b653-f161b0e26cce None None] Enqueued Resource ID: b971571c-73ca-401b-a9f1-4561ade84a6a with Priority: HIGHEST for action port [ 589.145691] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b971571c-73ca-401b-a9f1-4561ade84a6a with Priority: HIGHEST for action port [ 589.145993] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b971571c-73ca-401b-a9f1-4561ade84a6a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.147103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b971571c-73ca-401b-a9f1-4561ade84a6a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.147185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b971571c-73ca-401b-a9f1-4561ade84a6a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.147441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b971571c-73ca-401b-a9f1-4561ade84a6a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.147541] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b971571c-73ca-401b-a9f1-4561ade84a6a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.211150] env[65319]: INFO networking_nsxv3.common.synchronization [None req-bee34aa5-e6fd-43c3-b904-c1e1b575058c tempest-ServersTestFqdnHostnames-1763966681 tempest-ServersTestFqdnHostnames-1763966681-project-member] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 589.211150] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 589.214655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.214655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.430662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.430826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.430913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.431138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.431236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.431430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.431532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.431592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.431741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.431978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.431978] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f already deleted. [ 589.431978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.631951] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.631951] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.631951] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.632365] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.632405] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.632566] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.632689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.632941] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.633100] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.633466] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.633579] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.633685] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.633794] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.633907] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.634050] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.634785] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.650341] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b971571c-73ca-401b-a9f1-4561ade84a6a [ 589.650608] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.650729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.650797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.651021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.651114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.651205] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b971571c-73ca-401b-a9f1-4561ade84a6a already deleted. [ 589.651396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b971571c-73ca-401b-a9f1-4561ade84a6a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.687105] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.687105] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e already deleted. [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.687105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.687105] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.696900] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.696900] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.696900] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.696900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.696900] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.696900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.696900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.696900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.696900] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb39fe1-eed2-46d1-85d2-5dbe8f1f936b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.201185] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.201185] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port acb39fe1-eed2-46d1-85d2-5dbe8f1f936b not found, creating... [ 590.201185] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.201185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.201899] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.201899] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.201899] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.203999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.203999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.203999] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: acb39fe1-eed2-46d1-85d2-5dbe8f1f936b is going to be created. [ 590.212168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.212320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.212391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.212597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.212693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.212803] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e already deleted. [ 590.212892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.226117] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.226371] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.226560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.226751] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.227437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.227437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.265449] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b4a490b6-cfa0-41aa-8ee4-3512f08603ef None None] Enqueued Resource ID: eadec9ff-70d8-431f-abc9-57a6494a878c with Priority: HIGHEST for action port [ 590.266231] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eadec9ff-70d8-431f-abc9-57a6494a878c with Priority: HIGHEST for action port [ 590.266310] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-eadec9ff-70d8-431f-abc9-57a6494a878c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.266445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eadec9ff-70d8-431f-abc9-57a6494a878c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.266511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eadec9ff-70d8-431f-abc9-57a6494a878c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.266761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eadec9ff-70d8-431f-abc9-57a6494a878c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.266849] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eadec9ff-70d8-431f-abc9-57a6494a878c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.710278] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5f92ea5-dd9e-4649-af17-996396cda229 req-ecc31827-6448-456a-879c-a6753980ac83 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 590.711236] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 590.711236] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.711550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.711550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.711659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.711840] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.711951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.712745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.712745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.712745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.712745] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.771297] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eadec9ff-70d8-431f-abc9-57a6494a878c [ 590.772428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.772428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.772428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.772428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.773200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.773200] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eadec9ff-70d8-431f-abc9-57a6494a878c already deleted. [ 590.773200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eadec9ff-70d8-431f-abc9-57a6494a878c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.003279] env[65319]: INFO networking_nsxv3.common.synchronization [req-cc3d13b8-f7d0-418a-b2a3-4def8fcdde82 req-15157a16-e20d-4593-801e-9bec10670b30 service nova] Enqueued Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_rules [ 591.003279] env[65319]: INFO networking_nsxv3.common.synchronization [req-cc3d13b8-f7d0-418a-b2a3-4def8fcdde82 req-15157a16-e20d-4593-801e-9bec10670b30 service nova] Enqueued Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 591.003438] env[65319]: INFO networking_nsxv3.common.synchronization [req-cc3d13b8-f7d0-418a-b2a3-4def8fcdde82 req-15157a16-e20d-4593-801e-9bec10670b30 service nova] Enqueued Resource ID: acb39fe1-eed2-46d1-85d2-5dbe8f1f936b with Priority: HIGHEST for action port [ 591.003949] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_rules [ 591.004105] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 591.004206] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb39fe1-eed2-46d1-85d2-5dbe8f1f936b with Priority: HIGHEST for action port [ 591.004480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.004642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.004689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.004929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.004994] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.010170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.010170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.010170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.010453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.010614] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.010756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.011081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.011323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.011464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.011604] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.012996] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.012996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.012996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.013239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.013348] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb39fe1-eed2-46d1-85d2-5dbe8f1f936b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.216409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.216409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.216409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.216767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.216767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.216767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b already deleted. [ 591.216767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.243225] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.243549] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.244330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.244752] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.245020] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.245187] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.245305] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.245522] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.245701] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.245939] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.246086] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.246197] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.246302] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.246427] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.246539] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.247153] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.270335] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.270335] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.270335] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.270335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.270335] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-5b385885-d757-4c55-9765-55639ee8bfb6 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.270335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.270335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.270335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.270335] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b385885-d757-4c55-9765-55639ee8bfb6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.515963] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.516112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.525621] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.530207] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acb39fe1-eed2-46d1-85d2-5dbe8f1f936b with status ACTIVE [ 591.530440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.530574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.530846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.530887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.530970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.531154] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.531627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.531721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.531902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.532026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.532225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.532333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.532404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.532625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.532668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.532771] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acb39fe1-eed2-46d1-85d2-5dbe8f1f936b is going to be updated. [ 591.556689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.556848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.556885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.557123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.557272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.557429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acb39fe1-eed2-46d1-85d2-5dbe8f1f936b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.772072] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.772774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.773042] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.773455] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.773698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.773953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 5b385885-d757-4c55-9765-55639ee8bfb6 not found, creating... [ 591.774391] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.774698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.774909] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.775222] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.775456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.775858] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.778173] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.778173] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.778173] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.778173] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.778173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 5b385885-d757-4c55-9765-55639ee8bfb6 is going to be created. [ 591.799345] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.799594] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.799721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.800376] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.800660] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.800887] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.859502] env[65319]: INFO networking_nsxv3.common.synchronization [None req-16cdc41b-9850-4f63-953c-1d4effab6ccc None None] Enqueued Resource ID: 525307ba-8274-4ee9-952e-387a006e25a4 with Priority: HIGHEST for action port [ 591.859502] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 525307ba-8274-4ee9-952e-387a006e25a4 with Priority: HIGHEST for action port [ 591.859502] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-525307ba-8274-4ee9-952e-387a006e25a4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.859502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-525307ba-8274-4ee9-952e-387a006e25a4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.859502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-525307ba-8274-4ee9-952e-387a006e25a4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.859502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-525307ba-8274-4ee9-952e-387a006e25a4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.859502] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('525307ba-8274-4ee9-952e-387a006e25a4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.925845] env[65319]: INFO networking_nsxv3.common.synchronization [None req-862705ab-e6ec-4215-b2b5-62d5bddfb969 None None] Enqueued Resource ID: fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9 with Priority: HIGHEST for action port [ 591.926623] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9 with Priority: HIGHEST for action port [ 591.927777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.927884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.928562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.928562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.928562] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.035282] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.362194] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 525307ba-8274-4ee9-952e-387a006e25a4 [ 592.362423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.362554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.362621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.362828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.362913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.363012] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:525307ba-8274-4ee9-952e-387a006e25a4 already deleted. [ 592.363093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-525307ba-8274-4ee9-952e-387a006e25a4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.431142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9 [ 592.431539] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.431539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.431539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.431778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.432017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.432017] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9 already deleted. [ 592.432017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc14e5c2-2fa1-4a81-936f-74e92dd2d9c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.536543] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.536820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.536820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.536964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.537072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.537168] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f is going to be created. [ 592.567353] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.567617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.567617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.567809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.567973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.581171] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: UNINITIALIZED for 2s [ 592.627244] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5f92ea5-dd9e-4649-af17-996396cda229 req-770dc2ca-490f-4b07-bdb5-13e9a4f29cc7 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 592.627580] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5f92ea5-dd9e-4649-af17-996396cda229 req-770dc2ca-490f-4b07-bdb5-13e9a4f29cc7 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 592.627826] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5f92ea5-dd9e-4649-af17-996396cda229 req-770dc2ca-490f-4b07-bdb5-13e9a4f29cc7 service nova] Enqueued Resource ID: 5b385885-d757-4c55-9765-55639ee8bfb6 with Priority: HIGHEST for action port [ 592.628615] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 592.628855] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 592.631201] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b385885-d757-4c55-9765-55639ee8bfb6 with Priority: HIGHEST for action port [ 592.631201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.631201] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.631201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.631201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.631201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.631959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.631959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.631959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.631959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.631959] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.633993] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b385885-d757-4c55-9765-55639ee8bfb6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.633993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.633993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.633993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.634155] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b385885-d757-4c55-9765-55639ee8bfb6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.136164] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.136505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.136505] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.138038] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b385885-d757-4c55-9765-55639ee8bfb6 with status ACTIVE [ 593.138038] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.138280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.138280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.139579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.139579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.139827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.139877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.139914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.140065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.140630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.140630] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b385885-d757-4c55-9765-55639ee8bfb6 is going to be updated. [ 593.163527] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.163707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.163750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.163942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.164092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.164250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b385885-d757-4c55-9765-55639ee8bfb6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.642897] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.727536] env[65319]: INFO networking_nsxv3.common.synchronization [None req-26b85d5a-ad38-400d-a64d-f24c329e965e tempest-VolumesAssistedSnapshotsTest-925375010 tempest-VolumesAssistedSnapshotsTest-925375010-project-member] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 593.728068] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 593.728368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.728555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.728555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.728849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.728933] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.771669] env[65319]: INFO networking_nsxv3.common.synchronization [None req-39462fe6-4822-4766-8298-aa9ffc8b8138 None None] Enqueued Resource ID: 3b73cf11-497c-4294-969c-aa39f73d5359 with Priority: HIGHEST for action port [ 593.771669] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b73cf11-497c-4294-969c-aa39f73d5359 with Priority: HIGHEST for action port [ 593.771669] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b73cf11-497c-4294-969c-aa39f73d5359 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.771669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b73cf11-497c-4294-969c-aa39f73d5359" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.771669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b73cf11-497c-4294-969c-aa39f73d5359" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.771957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b73cf11-497c-4294-969c-aa39f73d5359" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.771957] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b73cf11-497c-4294-969c-aa39f73d5359',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.927138] env[65319]: INFO networking_nsxv3.common.synchronization [None req-968392af-2c78-4d17-944b-34939b427df8 tempest-VolumesAssistedSnapshotsTest-925375010 tempest-VolumesAssistedSnapshotsTest-925375010-project-member] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 593.927683] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 593.929074] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.929074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.149146] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.149146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.149146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.149146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.149146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.149146] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be created. [ 594.178173] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.178326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.178390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.178647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.178823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.190728] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: UNINITIALIZED for 2s [ 594.252106] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.252263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.252322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.252611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.252746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.252854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 already deleted. [ 594.252941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.253124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.253352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.253438] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.274294] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b73cf11-497c-4294-969c-aa39f73d5359 [ 594.274948] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.275116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.275184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.275407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.275504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.275630] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b73cf11-497c-4294-969c-aa39f73d5359 already deleted. [ 594.275716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b73cf11-497c-4294-969c-aa39f73d5359" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.591549] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: SUCCESS [ 594.591770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.591930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.592214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.592437] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.592590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.592655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.592786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.592865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.592979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.593083] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.782760] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.782969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.783071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.783351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.783485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.785091] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 already deleted. [ 594.785091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.096405] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.096508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.096673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.097084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.097747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.097949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.098038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.098218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.098331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.098414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.098586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.098676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.098737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.098901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.099068] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.099164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.099225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.099360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.099437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.099512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.099733] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.246184] env[65319]: INFO networking_nsxv3.common.synchronization [req-de5ff4bb-473c-4b20-bbb1-34d4395243f8 req-e8f41bf5-fb66-4b61-8295-e6d00d3a4515 tempest-DeleteServersAdminTestJSON-985890744 tempest-DeleteServersAdminTestJSON-985890744-project-member] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 595.247430] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 595.248767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.248767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.248767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.248767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.249059] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.249059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.249183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.249275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.249730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.249730] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.253150] env[65319]: INFO networking_nsxv3.common.synchronization [None req-53e4cdc9-c9ad-44d5-aa57-890222b01998 None None] Enqueued Resource ID: 70eb8c93-12fa-4a3e-b169-dd5c2a028c54 with Priority: HIGHEST for action port [ 595.254033] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eb8c93-12fa-4a3e-b169-dd5c2a028c54 with Priority: HIGHEST for action port [ 595.254950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-70eb8c93-12fa-4a3e-b169-dd5c2a028c54 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.254950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70eb8c93-12fa-4a3e-b169-dd5c2a028c54" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.254950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70eb8c93-12fa-4a3e-b169-dd5c2a028c54" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.254950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70eb8c93-12fa-4a3e-b169-dd5c2a028c54" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.254950] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70eb8c93-12fa-4a3e-b169-dd5c2a028c54',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.604454] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e81f5f5-3357-4ba5-96ae-679bd5c9617f: rpc.has_security_group_logging(os_id): False [ 595.628753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.628753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.629229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.629229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.629542] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.629699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.629816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.630050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.630328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.630583] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.631245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.631245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.631245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.631245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.631525] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f is going to be created. [ 595.664053] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.664342] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.664780] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.664897] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.665168] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.665324] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.665503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.665717] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.665868] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.666089] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.666219] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.666303] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.666413] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.666544] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.666676] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.666852] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.685837] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.686015] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.686150] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.686323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.686662] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-13ab322a-0074-4aaa-bd50-a195e9afa1e2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.686874] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.687051] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.687318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.687452] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13ab322a-0074-4aaa-bd50-a195e9afa1e2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.704639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.704639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.704639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.704639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.704639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.716251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: IN_PROGRESS for 2s [ 595.754586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.754879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.754948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.755336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.755407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.755660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.755835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.755896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.756208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.756344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.756663] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e already deleted. [ 595.756663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.760063] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70eb8c93-12fa-4a3e-b169-dd5c2a028c54 [ 595.760332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.760586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.760586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.760836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.760958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.761093] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70eb8c93-12fa-4a3e-b169-dd5c2a028c54 already deleted. [ 595.761220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70eb8c93-12fa-4a3e-b169-dd5c2a028c54" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.190199] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.190435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.190560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.190867] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.191071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.191461] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 13ab322a-0074-4aaa-bd50-a195e9afa1e2 not found, creating... [ 596.191461] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.191667] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.191818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.192017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.192163] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.192472] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.192641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.192794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.192955] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.193105] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.193242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 13ab322a-0074-4aaa-bd50-a195e9afa1e2 is going to be created. [ 596.204864] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 596.204864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.205299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.205299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.205657] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.205810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.206039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.206117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.206246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.206347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.206496] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.217837] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.218119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.218119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.218517] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.218608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.219219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.710550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.710883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.710883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.711017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.711247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.711332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.711369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.711509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.711599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.711689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.711934] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.711996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.712040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.712180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.712324] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.712416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.712475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.712611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.712687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.712765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.712853] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.967373] env[65319]: INFO networking_nsxv3.common.synchronization [req-de5ff4bb-473c-4b20-bbb1-34d4395243f8 req-7be12c8b-a148-445e-8ae3-1b05630cc3a4 service nova] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_rules [ 596.967658] env[65319]: INFO networking_nsxv3.common.synchronization [req-de5ff4bb-473c-4b20-bbb1-34d4395243f8 req-7be12c8b-a148-445e-8ae3-1b05630cc3a4 service nova] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 596.967816] env[65319]: INFO networking_nsxv3.common.synchronization [req-de5ff4bb-473c-4b20-bbb1-34d4395243f8 req-7be12c8b-a148-445e-8ae3-1b05630cc3a4 service nova] Enqueued Resource ID: 13ab322a-0074-4aaa-bd50-a195e9afa1e2 with Priority: HIGHEST for action port [ 596.968732] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_rules [ 596.969094] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 596.969381] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13ab322a-0074-4aaa-bd50-a195e9afa1e2 with Priority: HIGHEST for action port [ 596.970138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.970319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.970458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.970718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.971611] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.973830] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.974535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.974535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.974535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.974706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.974780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.974827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.975416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.975416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.975416] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.976333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-13ab322a-0074-4aaa-bd50-a195e9afa1e2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.976494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.976613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.976856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.976982] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13ab322a-0074-4aaa-bd50-a195e9afa1e2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.216989] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d51d74c1-0bc9-4f08-9e69-0f36720ce33b: rpc.has_security_group_logging(os_id): False [ 597.237115] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.237115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.237115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.237710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.237710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.237710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.237710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.237710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.238065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.238065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.238065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.238175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.238247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.238349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.238421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.238598] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.238690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.238752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.238889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.238961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.239103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be created. [ 597.297319] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.297501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.297554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.297726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.297922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.310421] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 597.479345] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.480295] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.480534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.480629] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13ab322a-0074-4aaa-bd50-a195e9afa1e2 with status ACTIVE [ 597.481498] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.481498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.481498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.481498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.481498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.481741] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.482873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.482873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.482873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.483546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.483546] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.483546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.484197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.484197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.484197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.484329] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13ab322a-0074-4aaa-bd50-a195e9afa1e2 is going to be updated. [ 597.511704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.511704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.511704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.511704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.511704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.511704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13ab322a-0074-4aaa-bd50-a195e9afa1e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.730867] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: SUCCESS [ 597.731153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.989060] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.094860] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3794c48-6235-4f08-9833-2634e24164b5 req-245f95e7-8114-4290-a0bd-6449c4647921 tempest-FloatingIPsAssociationNegativeTestJSON-789258298 tempest-FloatingIPsAssociationNegativeTestJSON-789258298-project-member] Enqueued Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 598.095417] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 598.095730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.095851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.095919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.096499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.096595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.096696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.096756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.096905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.096983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.097578] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.469573] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f05fb3e0-3464-4507-af7c-1ecd4f27d505 None None] Enqueued Resource ID: e3c006b0-bce9-4df1-af2d-c5bcf988bd3f with Priority: HIGHEST for action port [ 598.469890] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c006b0-bce9-4df1-af2d-c5bcf988bd3f with Priority: HIGHEST for action port [ 598.470200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c006b0-bce9-4df1-af2d-c5bcf988bd3f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.470325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c006b0-bce9-4df1-af2d-c5bcf988bd3f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.470384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c006b0-bce9-4df1-af2d-c5bcf988bd3f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.470632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c006b0-bce9-4df1-af2d-c5bcf988bd3f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.470713] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c006b0-bce9-4df1-af2d-c5bcf988bd3f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.491241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.491411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.491456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.491652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.491751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.491860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be created. [ 598.516615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.516754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.516920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.517040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.517196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.531514] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: UNINITIALIZED for 2s [ 598.599967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.600135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.600204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.600418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.600516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.600707] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.600802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.600863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.601016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.601096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.601197] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e already deleted. [ 598.601298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.972865] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3c006b0-bce9-4df1-af2d-c5bcf988bd3f [ 598.973728] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.974897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.974897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.975046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.975127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.975817] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3c006b0-bce9-4df1-af2d-c5bcf988bd3f already deleted. [ 598.975817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c006b0-bce9-4df1-af2d-c5bcf988bd3f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.047064] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.047064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-70" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.047064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-70" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.047064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-70" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.047064] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.047064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.047658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.048019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.048858] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.049480] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.049840] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.050097] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.050329] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.050838] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.050987] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.051428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.071679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.071679] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.071679] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.071679] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-70" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.072297] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-aed3f116-5dc6-4d69-9ea3-037a6b820faa taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.072297] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.072297] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.072643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.072829] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed3f116-5dc6-4d69-9ea3-037a6b820faa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.322800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 599.324906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.580021] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.580021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port aed3f116-5dc6-4d69-9ea3-037a6b820faa not found, creating... [ 599.580021] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.580021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.580476] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.580476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.580476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.580476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.580476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.580476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: aed3f116-5dc6-4d69-9ea3-037a6b820faa is going to be created. [ 599.600949] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.601176] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.602621] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.602621] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.602621] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.602621] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.328154] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3794c48-6235-4f08-9833-2634e24164b5 req-40295714-c5cf-4d23-ba78-db9175b2ca78 service nova] Enqueued Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_rules [ 600.328154] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3794c48-6235-4f08-9833-2634e24164b5 req-40295714-c5cf-4d23-ba78-db9175b2ca78 service nova] Enqueued Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 600.328154] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3794c48-6235-4f08-9833-2634e24164b5 req-40295714-c5cf-4d23-ba78-db9175b2ca78 service nova] Enqueued Resource ID: aed3f116-5dc6-4d69-9ea3-037a6b820faa with Priority: HIGHEST for action port [ 600.330491] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_rules [ 600.330770] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 600.331978] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed3f116-5dc6-4d69-9ea3-037a6b820faa with Priority: HIGHEST for action port [ 600.331978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.331978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.331978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.331978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.332279] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.337318] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.337413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.337501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.337630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.337789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.337983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.337983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.338367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.338367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.338692] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.339837] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed3f116-5dc6-4d69-9ea3-037a6b820faa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.340304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.340304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.340304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.340304] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed3f116-5dc6-4d69-9ea3-037a6b820faa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.542666] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 600.542885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.543395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.543690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.543869] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.544064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.544127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.544241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.544341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.544459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.544544] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.722486] env[65319]: INFO networking_nsxv3.common.synchronization [None req-4d297373-7c42-42b7-b646-cc2189e899e5 None None] Enqueued Resource ID: c0d670ed-2f1c-499d-ba0c-5b406499749c with Priority: HIGHEST for action port [ 600.722743] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d670ed-2f1c-499d-ba0c-5b406499749c with Priority: HIGHEST for action port [ 600.723344] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d670ed-2f1c-499d-ba0c-5b406499749c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.723622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d670ed-2f1c-499d-ba0c-5b406499749c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.723622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d670ed-2f1c-499d-ba0c-5b406499749c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.724153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d670ed-2f1c-499d-ba0c-5b406499749c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.724247] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d670ed-2f1c-499d-ba0c-5b406499749c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.843142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed3f116-5dc6-4d69-9ea3-037a6b820faa with status ACTIVE [ 600.847441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.847441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.847441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.847441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.847441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed3f116-5dc6-4d69-9ea3-037a6b820faa is going to be updated. [ 600.848016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.848284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.848575] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.872551] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.872551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.872551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.872761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.872761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.872895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed3f116-5dc6-4d69-9ea3-037a6b820faa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.011554] env[65319]: INFO networking_nsxv3.common.synchronization [None req-01a9b12b-534f-4b72-b9d9-08d0df3b17fa None None] Enqueued Resource ID: 1728aa51-82aa-4448-af23-d2d18ac25b11 with Priority: HIGHEST for action port [ 601.012102] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1728aa51-82aa-4448-af23-d2d18ac25b11 with Priority: HIGHEST for action port [ 601.012505] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1728aa51-82aa-4448-af23-d2d18ac25b11 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.012505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1728aa51-82aa-4448-af23-d2d18ac25b11" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.012667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1728aa51-82aa-4448-af23-d2d18ac25b11" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.012855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1728aa51-82aa-4448-af23-d2d18ac25b11" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.012927] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1728aa51-82aa-4448-af23-d2d18ac25b11',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.046522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.046695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.046775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.047207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.047626] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.047626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.047626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.047866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.047915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.048034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.048202] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.048351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.048408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.049066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.049066] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.049066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.049066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.049264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.049264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.049264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.049404] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.226211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0d670ed-2f1c-499d-ba0c-5b406499749c [ 601.226537] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.226626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.226671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.226927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.227027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.227114] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0d670ed-2f1c-499d-ba0c-5b406499749c already deleted. [ 601.227203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d670ed-2f1c-499d-ba0c-5b406499749c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.351638] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.515126] env[65319]: INFO networking_nsxv3.common.synchronization [req-ba668aed-742e-49d9-aa26-124c4232d2dc req-1c30f0ab-7b08-47e8-8b3f-b2a6c75c566d tempest-ImagesNegativeTestJSON-1750843251 tempest-ImagesNegativeTestJSON-1750843251-project-member] Enqueued Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 601.515126] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1728aa51-82aa-4448-af23-d2d18ac25b11 [ 601.515471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.515471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.515471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.515676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.515790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.515851] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1728aa51-82aa-4448-af23-d2d18ac25b11 already deleted. [ 601.515988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1728aa51-82aa-4448-af23-d2d18ac25b11" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.518485] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 601.520035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.520035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.520035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.520537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.520537] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.551913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23e179a6-db4e-4e51-ab65-7ae45a30f94e: rpc.has_security_group_logging(os_id): False [ 601.572815] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.574048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.574311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.574703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.575309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.575309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.575309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.575489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.575556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.575598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.576514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.576514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.576514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.576514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.576514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.576514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.576514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.576822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.576822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.576822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.576967] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be created. [ 601.693962] env[65319]: INFO networking_nsxv3.common.synchronization [None req-a7fb6fe7-fe73-40e9-a1cf-a9936d5ba4ed None None] Enqueued Resource ID: d4feb7db-875c-489c-9e86-5c2cc038616c with Priority: HIGHEST for action port [ 601.694178] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4feb7db-875c-489c-9e86-5c2cc038616c with Priority: HIGHEST for action port [ 601.695178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4feb7db-875c-489c-9e86-5c2cc038616c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.695178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4feb7db-875c-489c-9e86-5c2cc038616c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.695178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4feb7db-875c-489c-9e86-5c2cc038616c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.695178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4feb7db-875c-489c-9e86-5c2cc038616c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.695178] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4feb7db-875c-489c-9e86-5c2cc038616c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.699091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.699288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.699347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.699871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.699871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.720323] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 601.858376] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.858568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.858629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.858826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.858919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.859020] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e is going to be created. [ 601.890875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.890875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.890875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.890875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.890875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.900175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: UNINITIALIZED for 2s [ 602.025148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.025492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.025751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.026528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.026762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.027503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.027743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.028115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.029394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.029582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.029750] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b already deleted. [ 602.029915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.099652] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.099842] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.099937] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.100281] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.100598] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.100999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.100999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.101135] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.101318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.101433] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.101969] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.101969] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.101969] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.101969] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.101969] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.102126] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.122469] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.124119] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.124119] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.124119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.124119] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.124119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.124119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.124119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.124119] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90c13a76-7e8c-4dca-ba2a-c281e6d441c9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.198200] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4feb7db-875c-489c-9e86-5c2cc038616c [ 602.199184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.199184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.199184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.199184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.199184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.199522] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4feb7db-875c-489c-9e86-5c2cc038616c already deleted. [ 602.199522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4feb7db-875c-489c-9e86-5c2cc038616c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.626549] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.626549] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.626866] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.626904] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.628627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.628627] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 not found, creating... [ 602.628627] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.628627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.628627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.628627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.629570] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.630045] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.630351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.630620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.630960] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.632209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.632979] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 is going to be created. [ 602.655410] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.655410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.655410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.655410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.655410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.655410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.933147] env[65319]: INFO networking_nsxv3.common.synchronization [req-2d909820-9f36-4606-a74e-9d300ce50a60 req-98389557-f520-4f38-9335-df0317d29bb9 tempest-ServerDiagnosticsTest-794470998 tempest-ServerDiagnosticsTest-794470998-project-member] Enqueued Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 602.933874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 602.934334] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.934498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.934605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.934867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.935336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.935520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.935623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.935867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.936018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.936195] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.360035] env[65319]: INFO networking_nsxv3.common.synchronization [req-ba668aed-742e-49d9-aa26-124c4232d2dc req-62ca22eb-7677-49fd-ae16-55aa0ad8c9bc service nova] Enqueued Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_rules [ 603.360035] env[65319]: INFO networking_nsxv3.common.synchronization [req-ba668aed-742e-49d9-aa26-124c4232d2dc req-62ca22eb-7677-49fd-ae16-55aa0ad8c9bc service nova] Enqueued Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 603.360035] env[65319]: INFO networking_nsxv3.common.synchronization [req-ba668aed-742e-49d9-aa26-124c4232d2dc req-62ca22eb-7677-49fd-ae16-55aa0ad8c9bc service nova] Enqueued Resource ID: 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 with Priority: HIGHEST for action port [ 603.360035] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_rules [ 603.360035] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 603.363056] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 with Priority: HIGHEST for action port [ 603.363056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.363056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.363056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.363056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.363056] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.363772] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.363772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.363772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.363951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.364109] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.364211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.364271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.364977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.365089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.365179] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.366225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.366436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.366507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.366934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.367027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90c13a76-7e8c-4dca-ba2a-c281e6d441c9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.440509] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.440688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.440735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.440957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.441062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.441276] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.441374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.441415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.441562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.441645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.441743] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 already deleted. [ 603.441798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.548024] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.548024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.548024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.548024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.548740] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.551984] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.551984] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.551984] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.551984] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.551984] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.551984] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.551984] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.551984] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.551984] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.551984] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.551984] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.572549] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.575024] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.575024] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.575024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.575024] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-067c19d0-0d03-4b15-97eb-ae660be9627a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.575024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.575024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.575024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.575024] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067c19d0-0d03-4b15-97eb-ae660be9627a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.583760] env[65319]: INFO networking_nsxv3.common.synchronization [None req-0427f332-7583-47e6-894e-5e574b5c6493 None None] Enqueued Resource ID: 867b07a5-496b-4853-b52a-774964bbb3bb with Priority: HIGHEST for action port [ 603.584024] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867b07a5-496b-4853-b52a-774964bbb3bb with Priority: HIGHEST for action port [ 603.584608] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-867b07a5-496b-4853-b52a-774964bbb3bb taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.584679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-867b07a5-496b-4853-b52a-774964bbb3bb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.584749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-867b07a5-496b-4853-b52a-774964bbb3bb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.585030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-867b07a5-496b-4853-b52a-774964bbb3bb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.585141] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('867b07a5-496b-4853-b52a-774964bbb3bb',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.738642] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 603.738642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.868482] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.868683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.871144] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.873789] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 with status ACTIVE [ 603.874041] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.876854] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.876854] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.876854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.876854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90c13a76-7e8c-4dca-ba2a-c281e6d441c9 is going to be updated. [ 603.900240] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.900481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.900481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.900665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.900801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.900962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90c13a76-7e8c-4dca-ba2a-c281e6d441c9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.910285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: SUCCESS [ 603.911218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.911218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.911218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.911218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.911488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.911488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.911698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.911781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.911831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.911910] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.077317] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.077665] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.077784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.078071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.078211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.078348] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 067c19d0-0d03-4b15-97eb-ae660be9627a not found, creating... [ 604.078726] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.078892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.079027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.079301] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.080747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.080747] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.080747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.080747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.080747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.080747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.081045] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 067c19d0-0d03-4b15-97eb-ae660be9627a is going to be created. [ 604.087269] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 867b07a5-496b-4853-b52a-774964bbb3bb [ 604.087432] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.087568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.087655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.087830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.089101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.089101] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:867b07a5-496b-4853-b52a-774964bbb3bb already deleted. [ 604.089101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-867b07a5-496b-4853-b52a-774964bbb3bb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.109027] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.109027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.109027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.109027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.109027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.109027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.223997] env[65319]: INFO networking_nsxv3.common.synchronization [None req-6bb2568f-e88f-4fbc-bbc9-8e951ea1ac99 None None] Enqueued Resource ID: d88bf512-ba37-4c12-88d2-c1d369773fa8 with Priority: HIGHEST for action port [ 604.224664] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88bf512-ba37-4c12-88d2-c1d369773fa8 with Priority: HIGHEST for action port [ 604.225344] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d88bf512-ba37-4c12-88d2-c1d369773fa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.225665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d88bf512-ba37-4c12-88d2-c1d369773fa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.227094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d88bf512-ba37-4c12-88d2-c1d369773fa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.231062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d88bf512-ba37-4c12-88d2-c1d369773fa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.231207] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d88bf512-ba37-4c12-88d2-c1d369773fa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.374575] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.418529] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.418529] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.418529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.418931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.418931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.418931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.418931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.419078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.419211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.419257] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.419350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.419442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.419602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.419676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.419762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.419846] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.733060] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d88bf512-ba37-4c12-88d2-c1d369773fa8 [ 604.733417] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.733585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.733669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.734804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.734804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.734804] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d88bf512-ba37-4c12-88d2-c1d369773fa8 already deleted. [ 604.734804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d88bf512-ba37-4c12-88d2-c1d369773fa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.809119] env[65319]: INFO networking_nsxv3.common.synchronization [req-2d909820-9f36-4606-a74e-9d300ce50a60 req-9ebcf430-0911-4671-898c-a4ba3d4ba385 service nova] Enqueued Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_rules [ 604.809359] env[65319]: INFO networking_nsxv3.common.synchronization [req-2d909820-9f36-4606-a74e-9d300ce50a60 req-9ebcf430-0911-4671-898c-a4ba3d4ba385 service nova] Enqueued Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 604.809671] env[65319]: INFO networking_nsxv3.common.synchronization [req-2d909820-9f36-4606-a74e-9d300ce50a60 req-9ebcf430-0911-4671-898c-a4ba3d4ba385 service nova] Enqueued Resource ID: 067c19d0-0d03-4b15-97eb-ae660be9627a with Priority: HIGHEST for action port [ 604.811833] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_rules [ 604.811833] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 604.811833] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067c19d0-0d03-4b15-97eb-ae660be9627a with Priority: HIGHEST for action port [ 604.811833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.811833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.811833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.813337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.813625] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.819179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.819367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.819453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.819697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.819925] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.820067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.820148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.820321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.820433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.820564] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.822514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-067c19d0-0d03-4b15-97eb-ae660be9627a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.822514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.822514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.822769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.822810] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067c19d0-0d03-4b15-97eb-ae660be9627a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.877127] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.877287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.877346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.877563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.877654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.877754] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b is going to be created. [ 604.910977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.910977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.910977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.911258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.911493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.922447] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: UNINITIALIZED for 2s [ 604.925220] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0e2a77d-4c21-497a-85f5-76d08cf9878e: rpc.has_security_group_logging(os_id): False [ 604.947312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.947587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.947715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.947941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.948099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.948393] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.948645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.948645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.948777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.948899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.949135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.949238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.949300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.949448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.949526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.949788] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.949920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.950018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.950193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.950426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.950426] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e is going to be created. [ 605.026593] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.026593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.026593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.026853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.028039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.042844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: IN_PROGRESS for 2s [ 605.325747] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.327193] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.327336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.327555] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 067c19d0-0d03-4b15-97eb-ae660be9627a with status ACTIVE [ 605.327799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.328050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.328050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.328281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.328411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.328604] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.329447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.329577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.329775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.329902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.330326] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.330326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.330474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.330814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.331239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.331380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 067c19d0-0d03-4b15-97eb-ae660be9627a is going to be updated. [ 605.359678] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.361678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.361678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.361678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.361678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.361678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067c19d0-0d03-4b15-97eb-ae660be9627a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.455806] env[65319]: INFO networking_nsxv3.common.synchronization [None req-fb6354a1-6dca-4d3f-8792-dc91dbc7122c None None] Enqueued Resource ID: b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f with Priority: HIGHEST for action port [ 605.456379] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f with Priority: HIGHEST for action port [ 605.456681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.456798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.456860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.457732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.459587] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.604085] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5d6be46-9ff6-46bc-9371-6648c38a67df req-f43fff24-25ad-400a-8d34-6b41b0229a00 tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 605.605460] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 605.605860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.605989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.606070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.606612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.606807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.606917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.606983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.607172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.607279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.607373] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.834993] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.953026] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.953400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.953400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.953669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.954028] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.954198] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.954319] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.954569] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.954709] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.954906] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.955019] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.955140] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.955221] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.955333] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.955445] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.955573] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.961288] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f [ 605.961901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.961901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.961901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.961901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.961901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.962185] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f already deleted. [ 605.962185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1ca53e5-96b1-4cf0-884f-1ccfc4f2227f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.975703] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.976330] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.976330] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.976330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.976472] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-85e05152-726c-490a-b990-8c4cc988ce0b taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.976658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.976772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.977112] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.977247] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e05152-726c-490a-b990-8c4cc988ce0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.109765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.110491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.110491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.110491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.110491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.110788] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.110788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.110788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.110788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.110931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.110960] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d already deleted. [ 606.111114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.337596] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.337891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.337891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.338160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.338243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.338414] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 is going to be created. [ 606.363583] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.363780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.363842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.364098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.364265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.374825] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: UNINITIALIZED for 2s [ 606.479446] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.479684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.479807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.480107] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.480255] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.480407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 85e05152-726c-490a-b990-8c4cc988ce0b not found, creating... [ 606.480730] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.480895] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.481013] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.481251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.481384] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.481672] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.481844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.481942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.482243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.482385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.482530] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 85e05152-726c-490a-b990-8c4cc988ce0b is going to be created. [ 606.536152] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.536383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.536575] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.536843] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.536991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.537225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.934886] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: SUCCESS [ 606.935212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.935373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.935595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.935828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.935989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.936200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.936310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.936425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.936570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.936717] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.059888] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: SUCCESS [ 607.060238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.379249] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5d6be46-9ff6-46bc-9371-6648c38a67df req-205ce389-3e8e-4aa6-a741-61f3f25ee82c service nova] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_rules [ 607.379917] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5d6be46-9ff6-46bc-9371-6648c38a67df req-205ce389-3e8e-4aa6-a741-61f3f25ee82c service nova] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 607.379917] env[65319]: INFO networking_nsxv3.common.synchronization [req-f5d6be46-9ff6-46bc-9371-6648c38a67df req-205ce389-3e8e-4aa6-a741-61f3f25ee82c service nova] Enqueued Resource ID: 85e05152-726c-490a-b990-8c4cc988ce0b with Priority: HIGHEST for action port [ 607.380509] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_rules [ 607.380799] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 607.380957] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e05152-726c-490a-b990-8c4cc988ce0b with Priority: HIGHEST for action port [ 607.381456] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.381574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.382048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.382048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.382185] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.383257] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.383539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.383660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.383883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.384224] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.384779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.384779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.384779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.384779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.384970] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.386745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e05152-726c-490a-b990-8c4cc988ce0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.387385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.387385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.387513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.387599] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e05152-726c-490a-b990-8c4cc988ce0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.445259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.445423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.445497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.445833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.445912] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.446078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.446078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.446253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.446288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.446389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.446516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.446605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.446667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.447226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.447226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.447226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.447226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.447226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.447491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.447491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.447491] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.825063] env[65319]: INFO networking_nsxv3.common.synchronization [None req-1f7b5217-c46a-4b1f-a56b-9250db36060a None None] Enqueued Resource ID: dc13f358-c306-4ca6-8370-316c1ed4f260 with Priority: HIGHEST for action port [ 607.825229] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc13f358-c306-4ca6-8370-316c1ed4f260 with Priority: HIGHEST for action port [ 607.827627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc13f358-c306-4ca6-8370-316c1ed4f260 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.827627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc13f358-c306-4ca6-8370-316c1ed4f260" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.827627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc13f358-c306-4ca6-8370-316c1ed4f260" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.830826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc13f358-c306-4ca6-8370-316c1ed4f260" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.830826] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc13f358-c306-4ca6-8370-316c1ed4f260',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.890412] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.892325] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.892325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.892325] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85e05152-726c-490a-b990-8c4cc988ce0b with status ACTIVE [ 607.892536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.892536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.893542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.893542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.893542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.893542] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.893734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.893734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.893924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.894595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.894595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.894595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.894595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.895056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.895056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.895056] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85e05152-726c-490a-b990-8c4cc988ce0b is going to be updated. [ 607.919397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.919571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.919622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.919835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.920108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.920207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e05152-726c-490a-b990-8c4cc988ce0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.952476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b16325f-81df-4dc5-a284-76b424ad674b: rpc.has_security_group_logging(os_id): False [ 607.982037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.982613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.982675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.982925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.983051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.983285] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.983729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.983729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.983729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.983729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.983909] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.984011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.984074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.984646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.984646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.984793] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.984885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.985261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.985261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.985261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.985261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b is going to be created. [ 608.068574] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.068908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.068908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.069331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.069816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.087289] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: IN_PROGRESS for 2s [ 608.333704] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc13f358-c306-4ca6-8370-316c1ed4f260 [ 608.333704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.333704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.333704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.333704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.333704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.333704] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc13f358-c306-4ca6-8370-316c1ed4f260 already deleted. [ 608.333704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc13f358-c306-4ca6-8370-316c1ed4f260" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.387898] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: SUCCESS [ 608.388616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.388616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.388616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.388826] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.388890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.389297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.389297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.389297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.389297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.389464] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.400390] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.538183] env[65319]: INFO networking_nsxv3.common.synchronization [None req-89bcdf35-e8a6-4722-a204-4ad35d614f42 None None] Enqueued Resource ID: 6cd594cc-6526-46d7-a6bf-c77e07007721 with Priority: HIGHEST for action port [ 608.538747] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd594cc-6526-46d7-a6bf-c77e07007721 with Priority: HIGHEST for action port [ 608.539057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cd594cc-6526-46d7-a6bf-c77e07007721 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.539273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cd594cc-6526-46d7-a6bf-c77e07007721" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.539273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cd594cc-6526-46d7-a6bf-c77e07007721" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.539519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cd594cc-6526-46d7-a6bf-c77e07007721" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.539596] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd594cc-6526-46d7-a6bf-c77e07007721',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.892031] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.892226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.892292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.892632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.892834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.893199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.893199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.893299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.893345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.893476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.893687] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.893802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.893919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.894109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.894265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.895016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.895016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.895016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.895016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.895016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.895016] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.903942] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.903942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.903942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.904654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.904654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.904654] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be created. [ 608.932505] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.932505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.932505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.932897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.932964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.950884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: UNINITIALIZED for 2s [ 609.045948] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cd594cc-6526-46d7-a6bf-c77e07007721 [ 609.047989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.047989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.047989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.047989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.047989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.047989] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cd594cc-6526-46d7-a6bf-c77e07007721 already deleted. [ 609.047989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cd594cc-6526-46d7-a6bf-c77e07007721" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.398227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fb71eb3-0fda-4e33-ae51-390153750f63: rpc.has_security_group_logging(os_id): False [ 609.421260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.421439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.421577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.421711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.421801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.422038] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.422142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.422203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.422351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.422427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.422598] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.422831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.422831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.422919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.422958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.423137] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.423229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.423289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.423451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.423523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.423599] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 is going to be created. [ 609.489415] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.489415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.489415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.489415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.489615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.503409] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: IN_PROGRESS for 2s [ 610.101864] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: SUCCESS [ 610.102130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.966188] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 610.966188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.966188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.966188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.966188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.966188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.966429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.966429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.966485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.967084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.967084] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.120183] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c84ac3fe-ad78-4f56-b9c9-20238583b2e1 None None] Enqueued Resource ID: 2abcb30b-6781-48df-a581-48d5c9e1cff6 with Priority: HIGHEST for action port [ 611.120818] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2abcb30b-6781-48df-a581-48d5c9e1cff6 with Priority: HIGHEST for action port [ 611.120818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2abcb30b-6781-48df-a581-48d5c9e1cff6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.120956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2abcb30b-6781-48df-a581-48d5c9e1cff6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.120956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2abcb30b-6781-48df-a581-48d5c9e1cff6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.121193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2abcb30b-6781-48df-a581-48d5c9e1cff6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.121282] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2abcb30b-6781-48df-a581-48d5c9e1cff6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.368571] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7c2d62a0-7fa6-4faa-aff7-47585a7fbc20 None None] Enqueued Resource ID: 2a0a8bec-ca2d-4a7b-b933-78f812dff4dd with Priority: HIGHEST for action port [ 611.368730] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a0a8bec-ca2d-4a7b-b933-78f812dff4dd with Priority: HIGHEST for action port [ 611.368991] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a0a8bec-ca2d-4a7b-b933-78f812dff4dd taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.369190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a0a8bec-ca2d-4a7b-b933-78f812dff4dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.369256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a0a8bec-ca2d-4a7b-b933-78f812dff4dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.369531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a0a8bec-ca2d-4a7b-b933-78f812dff4dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.369639] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a0a8bec-ca2d-4a7b-b933-78f812dff4dd',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.470668] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.471531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.471531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.471531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.471739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.471799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.472041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.472516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.474415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.474415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.474618] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.474736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.474801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.474979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.475155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.476786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.476786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.476786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.476786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.476786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.476786] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.520506] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: SUCCESS [ 611.521048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.628769] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2abcb30b-6781-48df-a581-48d5c9e1cff6 [ 611.629546] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.629850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.629961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.630201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.630282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.630412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2abcb30b-6781-48df-a581-48d5c9e1cff6 already deleted. [ 611.630506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2abcb30b-6781-48df-a581-48d5c9e1cff6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.874645] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a0a8bec-ca2d-4a7b-b933-78f812dff4dd [ 611.874878] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.875313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.875397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.875522] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a0a8bec-ca2d-4a7b-b933-78f812dff4dd already deleted. [ 611.875611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a0a8bec-ca2d-4a7b-b933-78f812dff4dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.978763] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffe73d27-cd4d-4ef2-a753-b8b05d2db48d: rpc.has_security_group_logging(os_id): False [ 612.001169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.001413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.001413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.001617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.001709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.001899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.001997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.002078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.002221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.002297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.002496] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.002590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.002653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.002800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.002868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.003081] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.003172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.003233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.003420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.003477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.003559] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be created. [ 612.069184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.069346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.069416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.069629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.069809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.089319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 612.119578] env[65319]: INFO networking_nsxv3.common.synchronization [req-65564f67-5901-4d9e-ac55-28ef53f115e3 req-a3587216-ad29-4750-8d44-ba9a637533a8 tempest-ServersTestFqdnHostnames-1763966681 tempest-ServersTestFqdnHostnames-1763966681-project-member] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 612.119721] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 612.123764] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.123764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.123764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.124262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.124262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.124262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.124381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.124483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.124606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.124710] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.630560] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.630560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.630560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.630560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.630952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.630952] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.631060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.631101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.632073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.632073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.632073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e already deleted. [ 612.632073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.783545] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.783747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.783866] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.784201] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.784477] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.784639] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.784754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.784967] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.788208] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.788472] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.788594] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.788706] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.788850] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.788970] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.789126] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.789217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.814281] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.814469] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.814561] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.816109] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.816760] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-cc7beb64-4019-4564-b01b-3da0b6882743 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817139] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.818028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.818209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.818398] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc7beb64-4019-4564-b01b-3da0b6882743',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.037828] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ac9bf761-8285-4294-95a1-d7ddc506031c None None] Enqueued Resource ID: d715c429-c674-4534-b6df-c16264aec1e6 with Priority: HIGHEST for action port [ 613.037828] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d715c429-c674-4534-b6df-c16264aec1e6 with Priority: HIGHEST for action port [ 613.038443] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d715c429-c674-4534-b6df-c16264aec1e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.038597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d715c429-c674-4534-b6df-c16264aec1e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.038839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d715c429-c674-4534-b6df-c16264aec1e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.039279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d715c429-c674-4534-b6df-c16264aec1e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.039279] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d715c429-c674-4534-b6df-c16264aec1e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.323562] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.323920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.323920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.324275] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.324435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.324716] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port cc7beb64-4019-4564-b01b-3da0b6882743 not found, creating... [ 613.324920] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.325063] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.325175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.325439] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.325574] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.325879] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.327694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.327694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.327694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.327694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.327694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: cc7beb64-4019-4564-b01b-3da0b6882743 is going to be created. [ 613.355809] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.355809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.355809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.355809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.355809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.356314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.542491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d715c429-c674-4534-b6df-c16264aec1e6 [ 613.542757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.543205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.543205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.543205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.543432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.543472] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d715c429-c674-4534-b6df-c16264aec1e6 already deleted. [ 613.544281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d715c429-c674-4534-b6df-c16264aec1e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.833986] env[65319]: INFO networking_nsxv3.common.synchronization [None req-864a2c3a-8549-4510-9203-8aace1ec7023 None None] Enqueued Resource ID: aae5ca32-c25c-413c-b030-8d4bb0ebace5 with Priority: HIGHEST for action port [ 613.834951] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae5ca32-c25c-413c-b030-8d4bb0ebace5 with Priority: HIGHEST for action port [ 613.834951] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-aae5ca32-c25c-413c-b030-8d4bb0ebace5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.835097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aae5ca32-c25c-413c-b030-8d4bb0ebace5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.835136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aae5ca32-c25c-413c-b030-8d4bb0ebace5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.835415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aae5ca32-c25c-413c-b030-8d4bb0ebace5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.835571] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae5ca32-c25c-413c-b030-8d4bb0ebace5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.102546] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 614.102802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.109238] env[65319]: INFO networking_nsxv3.common.synchronization [req-65564f67-5901-4d9e-ac55-28ef53f115e3 req-43c386f5-ebb2-4280-a35c-8e0e263318f5 service nova] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 614.109401] env[65319]: INFO networking_nsxv3.common.synchronization [req-65564f67-5901-4d9e-ac55-28ef53f115e3 req-43c386f5-ebb2-4280-a35c-8e0e263318f5 service nova] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 614.109553] env[65319]: INFO networking_nsxv3.common.synchronization [req-65564f67-5901-4d9e-ac55-28ef53f115e3 req-43c386f5-ebb2-4280-a35c-8e0e263318f5 service nova] Enqueued Resource ID: cc7beb64-4019-4564-b01b-3da0b6882743 with Priority: HIGHEST for action port [ 614.109752] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_rules [ 614.109877] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 614.109970] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7beb64-4019-4564-b01b-3da0b6882743 with Priority: HIGHEST for action port [ 614.110521] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.110650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.110718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.110913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.110995] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.113159] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.113159] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.113159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.113638] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.114444] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc7beb64-4019-4564-b01b-3da0b6882743 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.114579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.114646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.115551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.115551] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc7beb64-4019-4564-b01b-3da0b6882743',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.337990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aae5ca32-c25c-413c-b030-8d4bb0ebace5 [ 614.338259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.338373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.338543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.338646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.338837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.338837] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aae5ca32-c25c-413c-b030-8d4bb0ebace5 already deleted. [ 614.338932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aae5ca32-c25c-413c-b030-8d4bb0ebace5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.483875] env[65319]: INFO networking_nsxv3.common.synchronization [req-e4cfa672-850a-44e7-929b-d3838b2203f7 req-3b43599b-a21e-4194-a56b-2423bb5521c6 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 614.483875] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 614.484179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.484317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.484472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.484758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.484999] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.485141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.485216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.485397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.485589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.485785] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.620901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.621767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.621767] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.622175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc7beb64-4019-4564-b01b-3da0b6882743 with status ACTIVE [ 614.622374] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.622533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.622620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.622848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.622938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.623133] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.623253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.623335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.623618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.623708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.623900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.625372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.625372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.625372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.625372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.625372] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc7beb64-4019-4564-b01b-3da0b6882743 is going to be updated. [ 614.650138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.650269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.650269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.650486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.650627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.650824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc7beb64-4019-4564-b01b-3da0b6882743" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.891604] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.891604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.891604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.891937] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.892813] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.892975] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.893099] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.893545] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.893697] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.893921] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.894067] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.894174] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.894274] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.895108] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.895310] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.895554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.920706] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.920706] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.920706] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.920706] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.920944] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-4563eadd-f19d-4a01-b309-a68ae078bc67 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.921041] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.921179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.921486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.921688] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4563eadd-f19d-4a01-b309-a68ae078bc67',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.989736] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.991109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.991109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.991109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.991109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.991535] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.991535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.991535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.991713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.991713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.991790] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 already deleted. [ 614.993257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.128031] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.326569] env[65319]: INFO networking_nsxv3.common.synchronization [None req-0e42aa6f-84bf-4e1c-98ae-0f3d195fa13f None None] Enqueued Resource ID: b60785e5-a0d9-4cfa-b2c6-3ead782f6b81 with Priority: HIGHEST for action port [ 615.328052] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60785e5-a0d9-4cfa-b2c6-3ead782f6b81 with Priority: HIGHEST for action port [ 615.328052] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60785e5-a0d9-4cfa-b2c6-3ead782f6b81 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.328052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60785e5-a0d9-4cfa-b2c6-3ead782f6b81" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.328052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60785e5-a0d9-4cfa-b2c6-3ead782f6b81" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.328488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60785e5-a0d9-4cfa-b2c6-3ead782f6b81" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.328587] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60785e5-a0d9-4cfa-b2c6-3ead782f6b81',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.425414] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.425785] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.425852] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.426247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.426479] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.426688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 4563eadd-f19d-4a01-b309-a68ae078bc67 not found, creating... [ 615.427689] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.427689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.427689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.428389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.428389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.428966] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.428966] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.429105] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.429607] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.429749] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.429940] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 is going to be created. [ 615.460028] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.460028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.460028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.460028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.460028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.460028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.631579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.631579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.631579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.631908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.632078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.632198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e is going to be created. [ 615.660661] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.660814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.660886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.661122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.661413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.674360] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: UNINITIALIZED for 2s [ 615.831806] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60785e5-a0d9-4cfa-b2c6-3ead782f6b81 [ 615.832972] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.833140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.833660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.834404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.834539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.834984] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60785e5-a0d9-4cfa-b2c6-3ead782f6b81 already deleted. [ 615.835122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60785e5-a0d9-4cfa-b2c6-3ead782f6b81" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.890308] env[65319]: INFO networking_nsxv3.common.synchronization [req-99b6edad-7746-48e1-a956-82c542593ab3 req-43635b61-e984-4de3-a325-dc258698174f tempest-VolumesAssistedSnapshotsTest-925375010 tempest-VolumesAssistedSnapshotsTest-925375010-project-member] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 615.891792] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 615.892333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.892525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.892629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.892996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.893257] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.893447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.893530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.893757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.893890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.894060] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.210894] env[65319]: INFO networking_nsxv3.common.synchronization [req-e4cfa672-850a-44e7-929b-d3838b2203f7 req-998e8468-5f4a-46f3-93de-752065a26a5c service nova] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 616.211697] env[65319]: INFO networking_nsxv3.common.synchronization [req-e4cfa672-850a-44e7-929b-d3838b2203f7 req-998e8468-5f4a-46f3-93de-752065a26a5c service nova] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 616.212031] env[65319]: INFO networking_nsxv3.common.synchronization [req-e4cfa672-850a-44e7-929b-d3838b2203f7 req-998e8468-5f4a-46f3-93de-752065a26a5c service nova] Enqueued Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 616.212641] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 616.212841] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 616.212981] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 616.213358] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.213811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.213811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.214163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.214326] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.215717] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.216147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.216147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.216292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.216649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.217012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.217446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.217446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.217633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.217838] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.219346] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4563eadd-f19d-4a01-b309-a68ae078bc67 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.219571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.221560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.221560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.221560] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4563eadd-f19d-4a01-b309-a68ae078bc67',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.398806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.398806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.398806] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 already deleted. [ 616.398806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.512356] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.512802] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-269" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.512802] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-269" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.513666] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-269" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.514594] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.514868] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.515095] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.515422] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.516212] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.516472] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.516615] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.516746] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.516857] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.517074] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.517074] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.517296] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.540275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.540475] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.540603] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.540734] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-269" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.541238] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.541472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.541581] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.541868] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.541991] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e799a5a-2ed4-40ac-8a7b-66ed548fee65',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.722061] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.723333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.723995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.723995] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4563eadd-f19d-4a01-b309-a68ae078bc67 with status ACTIVE [ 616.724771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.724911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.725219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.725808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.725808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.726039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.726126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.726206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.726451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.726628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.727036] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.727232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.727737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.727737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.727737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.727737] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 is going to be updated. [ 616.755078] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.755255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.755255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.755526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.755672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.755835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.045361] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.045754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.045974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.046348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.046561] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.046789] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 not found, creating... [ 617.047167] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.047414] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.047536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.047793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.047998] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.048483] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.048656] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.048772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.049403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.049403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.049403] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 is going to be created. [ 617.081075] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.081512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.081512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.081782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.082064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.082367] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.225057] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.687293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: SUCCESS [ 617.687578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.687728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.687970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.688163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.688284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.688348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.688584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.688584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.688668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.688738] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.728164] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.728363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.728363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.728565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.728658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.728756] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be created. [ 617.755178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.755347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.755400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.756509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.756509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.769925] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: UNINITIALIZED for 2s [ 617.787214] env[65319]: INFO networking_nsxv3.common.synchronization [req-99b6edad-7746-48e1-a956-82c542593ab3 req-2095fc74-69af-4380-850e-64732824a4f8 service nova] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 617.787214] env[65319]: INFO networking_nsxv3.common.synchronization [req-99b6edad-7746-48e1-a956-82c542593ab3 req-2095fc74-69af-4380-850e-64732824a4f8 service nova] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 617.787214] env[65319]: INFO networking_nsxv3.common.synchronization [req-99b6edad-7746-48e1-a956-82c542593ab3 req-2095fc74-69af-4380-850e-64732824a4f8 service nova] Enqueued Resource ID: 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 with Priority: HIGHEST for action port [ 617.787864] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_rules [ 617.788065] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 617.788177] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 with Priority: HIGHEST for action port [ 617.788461] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.788609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.788712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.788876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.788958] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.789824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.789936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790009] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.790829] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.791856] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.792028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.792028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.792184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.792259] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e799a5a-2ed4-40ac-8a7b-66ed548fee65',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.073198] env[65319]: INFO networking_nsxv3.common.synchronization [None req-bb255537-93cb-4ed7-bc70-a9cd4c1c85bb tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 618.074684] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 618.075103] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.075103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.075347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.076294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.077689] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.098908] env[65319]: INFO networking_nsxv3.common.synchronization [req-67aa6122-28ee-4441-87b5-0dee701acc99 req-c31ba580-e896-446a-a61f-688a21c94f46 tempest-ServerDiagnosticsNegativeTest-1512392746 tempest-ServerDiagnosticsNegativeTest-1512392746-project-member] Enqueued Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 618.099545] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f with Priority: HIGHEST for action security_group_members [ 618.099877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.100010] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.100083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.100282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.100431] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.100527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.100588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.100730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.100814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.100902] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e81f5f5-3357-4ba5-96ae-679bd5c9617f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.190518] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.294046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.294263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.294423] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.295488] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 with status ACTIVE [ 618.295753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.295895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.295940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.296184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.296282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.296767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.296767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.296767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.296906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.296944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.297710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.297820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.297944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.298814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.298814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.298814] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e799a5a-2ed4-40ac-8a7b-66ed548fee65 is going to be updated. [ 618.323154] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.323154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.323154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.323418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.323418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.323560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e799a5a-2ed4-40ac-8a7b-66ed548fee65" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.338096] env[65319]: INFO networking_nsxv3.common.synchronization [None req-15354532-b46e-4157-aa3f-c2c55cfa7cfd tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 618.339204] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 618.339204] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.339204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.494123] env[65319]: INFO networking_nsxv3.common.synchronization [req-30bbf5eb-3ea6-4cbe-b5f9-8b568897f666 req-752a3b60-db75-4d5a-b249-a7d868022137 tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 618.495272] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 618.496553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.496826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.496917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.497322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.497570] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.498228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.498329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.500718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.500718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.500859] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.605404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.605404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.605404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.605404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.605814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.605814] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa already deleted. [ 618.605814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.606083] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.606229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.606296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.606490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.606581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.607596] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.608465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.608465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.608465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.608718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.608718] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f is going to be updated. [ 618.611106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.613678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.613678] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.658074] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.658074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.658074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.658376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.661986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.672469] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: IN_PROGRESS for 2s [ 618.694295] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3fa756c-984c-4373-aa5f-0c3702edf82e: rpc.has_security_group_logging(os_id): False [ 618.721469] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.723309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.723309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.723309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e is going to be created. [ 618.803091] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.817200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.817466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.817745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.817959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.836885] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: IN_PROGRESS for 2s [ 619.003975] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.004443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.004443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.004656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.004656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.005274] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.005274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.005274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.005274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.005610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.005610] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 already deleted. [ 619.005610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.097189] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5c52d0ea-b574-482e-a5bb-214ed32afd96 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 619.098237] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 619.099013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.099175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.099272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.099650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.099650] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.137536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.137536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.137536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.137536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.137536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.137536] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa already deleted. [ 619.137907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.207954] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.210161] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.210335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.211348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.211850] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.212170] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.212301] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.212552] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.212696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.212910] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.213031] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.213172] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.213282] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.213417] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.213768] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.213863] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.239139] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.239936] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.239936] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.239936] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.241044] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5b8d9edd-0891-4ae6-8570-bf68cb875820 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.241331] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.241506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241827] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241975] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b8d9edd-0891-4ae6-8570-bf68cb875820',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.305784] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.305962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.306022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.306244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.306334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.306428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 is going to be created. [ 619.337173] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.337420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.337420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.337590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.337749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.348854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: UNINITIALIZED for 2s [ 619.629046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.629046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.629046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.629046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.629046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.629046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 already deleted. [ 619.629046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.712841] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7052f7ed-25f3-4216-b583-61a651972ed8 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 619.713368] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 619.713739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.713864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.713927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.714192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.714285] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.745316] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.746256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.746256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.746256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.746256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.746488] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 5b8d9edd-0891-4ae6-8570-bf68cb875820 not found, creating... [ 619.746673] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.746880] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.747011] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.747244] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.747380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.747690] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.747882] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.748039] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.748325] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.748516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.748737] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5b8d9edd-0891-4ae6-8570-bf68cb875820 is going to be created. [ 619.773229] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.773361] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.773514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.773803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.774063] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.774323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.781862] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 619.782194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.782773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.782990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.783201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.783325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.783424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.783793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.784043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.784225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.784361] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.239490] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.239739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.239739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.239964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.240026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.240285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 already deleted. [ 620.240285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.286652] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.286868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.288147] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.288147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.288548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.288548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.288548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.288703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.288758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.288912] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.289017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.289777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.289777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.289777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.289978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.290028] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.481880] env[65319]: INFO networking_nsxv3.common.synchronization [req-30bbf5eb-3ea6-4cbe-b5f9-8b568897f666 req-b88cc236-3838-43af-82b9-262964af1bda service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 620.481880] env[65319]: INFO networking_nsxv3.common.synchronization [req-30bbf5eb-3ea6-4cbe-b5f9-8b568897f666 req-b88cc236-3838-43af-82b9-262964af1bda service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 620.482084] env[65319]: INFO networking_nsxv3.common.synchronization [req-30bbf5eb-3ea6-4cbe-b5f9-8b568897f666 req-b88cc236-3838-43af-82b9-262964af1bda service nova] Enqueued Resource ID: 5b8d9edd-0891-4ae6-8570-bf68cb875820 with Priority: HIGHEST for action port [ 620.482614] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 620.482810] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 620.482884] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b8d9edd-0891-4ae6-8570-bf68cb875820 with Priority: HIGHEST for action port [ 620.483174] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.483499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.483499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.483953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.483953] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.484752] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.484901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.484952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.485201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.485336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.485430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.485504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.485667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.485782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.485881] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.487112] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b8d9edd-0891-4ae6-8570-bf68cb875820 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.487232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.487337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.487479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.487553] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b8d9edd-0891-4ae6-8570-bf68cb875820',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.683769] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f in Status: SUCCESS [ 620.683868] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e81f5f5-3357-4ba5-96ae-679bd5c9617f deletion is rescheduled due to dependency. [ 620.684009] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e81f5f5-3357-4ba5-96ae-679bd5c9617f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.793517] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 620.814916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.815147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.815272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.815646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.815827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.816105] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.816213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.816280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.816455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.816541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.817125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.817302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.817533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.817999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.818158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.818525] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.818699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.818858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.819070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.819201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.819332] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be created. [ 620.851582] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: SUCCESS [ 620.851869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.899209] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.899209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.899209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.899209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.899209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.923964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 620.990411] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.990697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.991371] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.992136] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b8d9edd-0891-4ae6-8570-bf68cb875820 with status ACTIVE [ 620.992296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.992460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.992534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.993515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.993515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.993868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.994034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.994115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.994328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.994429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.994713] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.994828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.994906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.995110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.995269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.995687] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b8d9edd-0891-4ae6-8570-bf68cb875820 is going to be updated. [ 621.032753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.033064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.033064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.033230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.033470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.033807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b8d9edd-0891-4ae6-8570-bf68cb875820" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168955] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-1d0011f2-3fa2-45c2-8546-b3c6e77e06e5 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 621.169289] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 621.169842] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.169842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.169842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.170116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.170475] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.170475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.170475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.170680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.170732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.170801] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.363046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: SUCCESS [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.363046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.363046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.363046] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.500585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.663254] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.663638] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.663875] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.664461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.664679] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.664884] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.665034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.665354] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.665480] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.665756] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.665953] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.666076] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.666183] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.666692] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.666843] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.666982] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.672918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.673070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.673128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.673324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.673483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.673819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.673819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.674013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.674057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.674119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.674208] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade already deleted. [ 621.674273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.693677] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.693891] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.694021] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.694107] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.694574] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-b05fc3c1-7fac-48db-b38d-620f22549aa5 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.694758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.694915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.695313] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.695416] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b05fc3c1-7fac-48db-b38d-620f22549aa5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.869052] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.004263] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.004526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.004608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.004839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.004950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.005065] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be created. [ 622.042711] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.042838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.042915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.043219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.043443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.057247] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: UNINITIALIZED for 2s [ 622.198158] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.198655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.198806] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.199113] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.199266] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.199428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port b05fc3c1-7fac-48db-b38d-620f22549aa5 not found, creating... [ 622.199710] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.199870] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.199996] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.200244] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.200503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.200656] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.200811] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.200905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.201495] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.201583] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.201739] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: b05fc3c1-7fac-48db-b38d-620f22549aa5 is going to be created. [ 622.236556] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.236747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.236869] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.237170] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.238243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.238243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.371740] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8289f43-cccf-41f3-8768-9719094a27c3: rpc.has_security_group_logging(os_id): False [ 622.397481] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.397481] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.397481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.397966] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 is going to be created. [ 622.475799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.475799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.475799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.475799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.475799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.485861] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: IN_PROGRESS for 2s [ 622.509815] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7f26822-e1a3-4b4c-90e4-69b7c16124f4 req-9fa21d9d-5c6b-4ac2-9374-e3e66338d4d5 tempest-DeleteServersAdminTestJSON-173391681 tempest-DeleteServersAdminTestJSON-173391681-project-admin] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 622.510385] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 622.510756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.510909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.510960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.511161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.511345] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.511483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.511483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.511646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.511779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.511819] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.718854] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8f54a72b-7a04-4a13-82ec-7b71c56e853d None None] Enqueued Resource ID: 484c5c5c-7a41-4c3a-9863-e4f2df4ede7e with Priority: HIGHEST for action port [ 622.719535] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484c5c5c-7a41-4c3a-9863-e4f2df4ede7e with Priority: HIGHEST for action port [ 622.719754] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-484c5c5c-7a41-4c3a-9863-e4f2df4ede7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.719886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-484c5c5c-7a41-4c3a-9863-e4f2df4ede7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.719961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-484c5c5c-7a41-4c3a-9863-e4f2df4ede7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.720245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-484c5c5c-7a41-4c3a-9863-e4f2df4ede7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.720412] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('484c5c5c-7a41-4c3a-9863-e4f2df4ede7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.763370] env[65319]: INFO networking_nsxv3.common.synchronization [req-eb952183-1ba9-49d8-9b8e-d03e2dec1284 req-4026dda3-bd9b-4aa2-b22e-91bfe58840bb tempest-SecurityGroupRulesNegativeTestJSON-697016015 tempest-SecurityGroupRulesNegativeTestJSON-697016015-project-member] Enqueued Resource ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 with Priority: HIGHEST for action security_group_rules [ 622.764017] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 with Priority: HIGHEST for action security_group_rules [ 622.764569] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.764697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.764767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.765044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.765130] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0c1dbf0-c42f-4b05-a7f4-c2ec59555692',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.940616] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 622.941083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-e03c4d13-764c-453d-aed2-8853ddf16bf9 service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-e03c4d13-764c-453d-aed2-8853ddf16bf9 service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-e03c4d13-764c-453d-aed2-8853ddf16bf9 service nova] Enqueued Resource ID: b05fc3c1-7fac-48db-b38d-620f22549aa5 with Priority: HIGHEST for action port [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 622.970567] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05fc3c1-7fac-48db-b38d-620f22549aa5 with Priority: HIGHEST for action port [ 622.970567] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.970567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.970567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.970961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.970961] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.972713] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.972933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.978024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.978024] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.978024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b05fc3c1-7fac-48db-b38d-620f22549aa5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.978024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.978024] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b05fc3c1-7fac-48db-b38d-620f22549aa5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.014548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.014788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.014913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.015454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.015454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.015916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.015916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.016125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.016229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.017087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.017087] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be updated. [ 623.060711] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.060918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.060971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.061248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.061467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.073914] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 623.147417] env[65319]: INFO networking_nsxv3.common.synchronization [req-332d8fa0-020d-464a-a999-c59b5a788ed6 req-71afcb21-f10f-4429-8699-9160c893c8ed tempest-ImagesNegativeTestJSON-1750843251 tempest-ImagesNegativeTestJSON-1750843251-project-member] Enqueued Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 623.148326] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGHEST for action security_group_members [ 623.148883] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.149190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.149374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.153138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.153635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.153855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.154030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.154553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.154657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.154769] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.222622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 484c5c5c-7a41-4c3a-9863-e4f2df4ede7e [ 623.223056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.223211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.223281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.223727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.223915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.224427] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:484c5c5c-7a41-4c3a-9863-e4f2df4ede7e already deleted. [ 623.224427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-484c5c5c-7a41-4c3a-9863-e4f2df4ede7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.289233] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.289342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.289385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.289591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.289712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.289788] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 already deleted. [ 623.289867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.469842] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-d4dddfdf-bd3f-4da0-b2f5-4b554000b604 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 623.470436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 623.471087] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.471087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.479025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.479025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.479025] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.482071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b05fc3c1-7fac-48db-b38d-620f22549aa5 with status ACTIVE [ 623.482313] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.482449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.482508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.482725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.482814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.483051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.483108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.483172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.483327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.483409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.483637] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.483821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.483821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.484230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.484230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.484230] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b05fc3c1-7fac-48db-b38d-620f22549aa5 is going to be updated. [ 623.571628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.571628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.571628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.571769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.571819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.571969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b05fc3c1-7fac-48db-b38d-620f22549aa5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.658530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.658715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.658784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.659057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.659173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.659391] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.659494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.659571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.661476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.661476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.661476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b is going to be updated. [ 623.701648] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.701923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.701923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.702151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.702344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.717016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: IN_PROGRESS for 2s [ 623.881061] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.881337] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.881503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.881837] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.886645] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.886645] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.886645] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.886645] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.886645] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.886645] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.886645] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.886645] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.886645] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.886645] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.886645] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.886645] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.906626] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.906814] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.906922] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.907152] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.907571] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-83456cdb-4988-4191-8aec-a5cad9adcbe6 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.907827] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.908043] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.912397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.912397] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83456cdb-4988-4191-8aec-a5cad9adcbe6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.982608] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.068574] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 624.068834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.069034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.069268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.069480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.069605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.069673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.069874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.069989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.069989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.070096] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.414828] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.415055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.415182] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.415480] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.415620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.415773] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 83456cdb-4988-4191-8aec-a5cad9adcbe6 not found, creating... [ 624.416088] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.416249] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.416362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.416582] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.417596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.417596] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.417596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.417596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.417596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.417596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.417831] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 83456cdb-4988-4191-8aec-a5cad9adcbe6 is going to be created. [ 624.439508] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.439766] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.439823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.440151] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.440322] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.440545] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.486559] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.487881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.487881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.487881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.487881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.487881] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be created. [ 624.502407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: SUCCESS [ 624.502647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.532819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.532819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.532819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.532819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.532819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.549463] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: UNINITIALIZED for 2s [ 624.572906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.576024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.576024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.576024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.576024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.576773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.577247] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.079530] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6058afe7-0c04-438a-8ff7-fa0b65021981: rpc.has_security_group_logging(os_id): False [ 625.086050] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 625.087456] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e deletion is rescheduled due to dependency. [ 625.087600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.098009] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.098216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.098292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.098518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.098610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.098843] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.098941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.099016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.099200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.099280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.099950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.099950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.099950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.099950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.099950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.100202] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.100500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.100572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.100799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.100799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.100903] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be created. [ 625.161510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.161510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.161510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.161510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.161695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.175102] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 625.250089] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ad11039e-5ea4-4973-ba1c-6da0f8e665da None None] Enqueued Resource ID: f1746ad4-941c-4ac6-bf2c-64a854b9760b with Priority: HIGHEST for action port [ 625.250089] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1746ad4-941c-4ac6-bf2c-64a854b9760b with Priority: HIGHEST for action port [ 625.250510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1746ad4-941c-4ac6-bf2c-64a854b9760b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.250510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1746ad4-941c-4ac6-bf2c-64a854b9760b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.250510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1746ad4-941c-4ac6-bf2c-64a854b9760b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.250717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1746ad4-941c-4ac6-bf2c-64a854b9760b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.250796] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1746ad4-941c-4ac6-bf2c-64a854b9760b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.268129] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-090b8787-a73c-4505-aa8a-5609e2c9e3ef service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 625.268300] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-090b8787-a73c-4505-aa8a-5609e2c9e3ef service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 625.268437] env[65319]: INFO networking_nsxv3.common.synchronization [req-85a90b5a-d2cc-4feb-b47f-178b6d74eeb1 req-090b8787-a73c-4505-aa8a-5609e2c9e3ef service nova] Enqueued Resource ID: 83456cdb-4988-4191-8aec-a5cad9adcbe6 with Priority: HIGHEST for action port [ 625.269658] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 625.269726] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 625.274344] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83456cdb-4988-4191-8aec-a5cad9adcbe6 with Priority: HIGHEST for action port [ 625.277035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.277035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.277035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.277035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.277035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-83456cdb-4988-4191-8aec-a5cad9adcbe6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.277035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.278821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.282043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.282043] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83456cdb-4988-4191-8aec-a5cad9adcbe6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.674739] env[65319]: INFO networking_nsxv3.common.synchronization [req-2f23242f-b00d-4e65-b6f5-24feff26debc req-65af3e5e-3ee2-40fd-9751-8378b130585f tempest-VolumesAdminNegativeTest-6164972 tempest-VolumesAdminNegativeTest-6164972-project-member] Enqueued Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 625.674841] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 625.675108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.675239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.675308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.675571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.675730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.675841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.675910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.678150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.678317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.678416] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.727697] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b16325f-81df-4dc5-a284-76b424ad674b in Status: SUCCESS [ 625.727876] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b deletion is rescheduled due to dependency. [ 625.727996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.755354] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1746ad4-941c-4ac6-bf2c-64a854b9760b [ 625.755616] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.755766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.755842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.756124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.756220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.756310] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1746ad4-941c-4ac6-bf2c-64a854b9760b already deleted. [ 625.756370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1746ad4-941c-4ac6-bf2c-64a854b9760b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.784767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83456cdb-4988-4191-8aec-a5cad9adcbe6 with status ACTIVE [ 625.785148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.785345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.785451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.785833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.786032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.786250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.786369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.786440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.786623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.786712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.786937] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.787085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.787157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.787333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.787415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787515] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83456cdb-4988-4191-8aec-a5cad9adcbe6 is going to be updated. [ 625.812638] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.812796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.812843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83456cdb-4988-4191-8aec-a5cad9adcbe6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.028975] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.029977] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-686" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.029977] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-686" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.029977] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-686" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.030167] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.030365] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.030901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.030901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.031032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.031192] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.031301] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.031477] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.031594] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.031721] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.032496] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.032496] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.057933] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.058105] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.058735] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.058735] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-686" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.058735] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-e817d764-1bd8-486d-8d75-220350c39245 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.059081] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.059122] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.059421] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.059577] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e817d764-1bd8-486d-8d75-220350c39245',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.181850] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.182232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.182232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.182337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.182375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.182599] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.182749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.182827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.183019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.183113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.183203] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 already deleted. [ 626.183287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.560909] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 626.561229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.561894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.561894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.561894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.562154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.562154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.562294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.562375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.562473] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.563868] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.564143] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.564333] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.564671] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.567901] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port e817d764-1bd8-486d-8d75-220350c39245 not found, creating... [ 626.567901] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.567901] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.567901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.568468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.568468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.568468] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: e817d764-1bd8-486d-8d75-220350c39245 is going to be created. [ 626.592353] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.592682] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.592682] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.593062] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.593296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.593587] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.071112] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.199639] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 627.199639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.356655] env[65319]: INFO networking_nsxv3.common.synchronization [req-2f23242f-b00d-4e65-b6f5-24feff26debc req-51db6d5c-6b42-4c3e-9ca6-1ddf6122a692 service nova] Enqueued Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_rules [ 627.356822] env[65319]: INFO networking_nsxv3.common.synchronization [req-2f23242f-b00d-4e65-b6f5-24feff26debc req-51db6d5c-6b42-4c3e-9ca6-1ddf6122a692 service nova] Enqueued Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 627.356975] env[65319]: INFO networking_nsxv3.common.synchronization [req-2f23242f-b00d-4e65-b6f5-24feff26debc req-51db6d5c-6b42-4c3e-9ca6-1ddf6122a692 service nova] Enqueued Resource ID: e817d764-1bd8-486d-8d75-220350c39245 with Priority: HIGHEST for action port [ 627.357893] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_rules [ 627.357893] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 627.357893] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e817d764-1bd8-486d-8d75-220350c39245 with Priority: HIGHEST for action port [ 627.359309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.359309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.359309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.359469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.359469] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.363751] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.366721] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.366721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.367340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.367340] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.368558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e817d764-1bd8-486d-8d75-220350c39245 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.368747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.368793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.369077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.369202] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e817d764-1bd8-486d-8d75-220350c39245',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.573966] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.874063] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e817d764-1bd8-486d-8d75-220350c39245 with status ACTIVE [ 627.874211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.874317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.874362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.874582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.874681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.874854] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.874952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.875186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.875261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.875439] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.875530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.875858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.876058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.876113] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e817d764-1bd8-486d-8d75-220350c39245 is going to be updated. [ 627.879592] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.880635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.881260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.905804] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.905983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.906042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.906244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.906381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.906541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e817d764-1bd8-486d-8d75-220350c39245" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.077400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.077400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.077400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.077400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.077661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.077661] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 628.114992] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.115105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.115153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.115339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.115543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.127812] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 628.382053] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.694280] env[65319]: INFO networking_nsxv3.common.synchronization [req-212948a4-e049-4e2a-9303-82743081917c req-668cd934-1b55-4d55-9214-0c1f07272fb9 tempest-ServerDiagnosticsTest-794470998 tempest-ServerDiagnosticsTest-794470998-project-member] Enqueued Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 628.694901] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGHEST for action security_group_members [ 628.695618] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.695618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.695618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.695872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.695969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.696084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.696147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.696294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.696379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.696499] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.886945] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.887329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.887467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.887754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.887904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.888023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 is going to be created. [ 628.916473] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.916473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.916473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.916692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.916977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.929202] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: UNINITIALIZED for 2s [ 629.199678] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.199923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.200028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.200327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.200439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.200669] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.200811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.200888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.201106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.201182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.201278] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 is going to be updated. [ 629.248438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.248438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.248438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.248781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.248781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.261623] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: IN_PROGRESS for 2s [ 630.141791] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 630.142249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.142249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.142735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.142981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.143129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.143200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.143386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.143543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.143631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.143741] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.145921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.146129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.146328] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.146445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.146536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.146720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.146801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.146948] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.296291] env[65319]: INFO networking_nsxv3.common.synchronization [req-7260ba65-dbdd-4683-849f-671dbcf974ab req-aa81c7ad-6d31-4f45-9619-cbb2bcd1b4c9 tempest-SecurityGroupRulesNegativeTestJSON-697016015 tempest-SecurityGroupRulesNegativeTestJSON-697016015-project-member] Enqueued Resource ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 with Priority: HIGHEST for action security_group_rules [ 630.298801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 with Priority: HIGHEST for action security_group_rules [ 630.300742] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.300742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.300742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.300742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.300742] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0c1dbf0-c42f-4b05-a7f4-c2ec59555692',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.648575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.648852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.649578] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.830382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.830555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.830714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.830970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.831568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.831683] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0c1dbf0-c42f-4b05-a7f4-c2ec59555692 already deleted. [ 630.831871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0c1dbf0-c42f-4b05-a7f4-c2ec59555692" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.941073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: SUCCESS [ 630.941298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.941543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.941797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.942197] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.942197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.942361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.942457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.942548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.942671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.942969] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.151571] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.272497] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 in Status: SUCCESS [ 631.272497] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 deletion is rescheduled due to dependency. [ 631.272872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.449779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.451083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.451083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.451083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.451491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.451768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.451965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.454276] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.454276] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.454276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.454276] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.654880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.655491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.655947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.656284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.658735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.658735] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 631.700022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.700230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.700294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.700490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.700672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.713099] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 631.957074] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dadc0194-ac9d-406b-a9c6-ec6492e3d268: rpc.has_security_group_logging(os_id): False [ 631.991255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.991255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.991255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.991255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.991689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.991689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.991689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.991689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.991851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.991989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.992147] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.992244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.992304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.992449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.992518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.992822] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.992916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.992977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.993256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.993256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.993374] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 is going to be created. [ 632.075398] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.075539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.075672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.075939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.076168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.092284] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: IN_PROGRESS for 2s [ 632.543912] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 632.544306] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 632.545665] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 632.545665] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 632.545853] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.546041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.546041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.546319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.546490] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.546653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.546720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.546956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.547100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.547176] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.548332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.550143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.550143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.550143] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.607672] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_rules [ 632.607672] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 632.607672] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 632.607798] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 632.608047] env[65319]: INFO networking_nsxv3.common.synchronization [req-28b89da0-2ca6-4439-8507-e735a216c4ab req-c9ebb1ee-35fc-48d5-be71-b39112356327 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 632.608871] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_rules [ 632.609098] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 632.609276] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 632.609437] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 632.609591] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 632.610822] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.610822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.610952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.611576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.611576] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.617146] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.617146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.617146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.617146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.617146] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.624378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4563eadd-f19d-4a01-b309-a68ae078bc67 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.624378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.624378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.624378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.624378] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4563eadd-f19d-4a01-b309-a68ae078bc67',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.624779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.624779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.627825] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.627999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.056114] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.056114] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.117144] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.117144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.126880] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4563eadd-f19d-4a01-b309-a68ae078bc67 with status ACTIVE [ 633.126880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.126880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.126880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.126880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.127915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.127915] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 is going to be updated. [ 633.129776] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.130172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.158042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.158042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.158042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.158042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.158042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.158042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.191372] env[65319]: INFO networking_nsxv3.common.synchronization [None req-fa739422-ac92-4329-85b9-7f8b09b7035e None None] Enqueued Resource ID: abcc963f-7530-4b41-bb65-e17eaafe661e with Priority: HIGHEST for action port [ 633.192270] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abcc963f-7530-4b41-bb65-e17eaafe661e with Priority: HIGHEST for action port [ 633.193149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-abcc963f-7530-4b41-bb65-e17eaafe661e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.193149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abcc963f-7530-4b41-bb65-e17eaafe661e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.193149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abcc963f-7530-4b41-bb65-e17eaafe661e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.193318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abcc963f-7530-4b41-bb65-e17eaafe661e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.193546] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abcc963f-7530-4b41-bb65-e17eaafe661e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.561727] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.563065] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.696184] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abcc963f-7530-4b41-bb65-e17eaafe661e [ 633.697692] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.698409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.698615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.698946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.699151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.699285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abcc963f-7530-4b41-bb65-e17eaafe661e already deleted. [ 633.699386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abcc963f-7530-4b41-bb65-e17eaafe661e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.724732] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 633.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.726155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.726327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.726565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.726820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.726913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.727023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.727247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.727363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.727438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.727625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.727791] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.727887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.727945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.728098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.728172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.728358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.728496] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.064384] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.064613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.064735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.067561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.067561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.067561] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be created. [ 634.071634] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.071836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.072031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.072371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.072563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.072563] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 634.122215] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.122481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.122586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.123251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.123251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.127874] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: SUCCESS [ 634.127874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.130553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.132716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.132716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.132716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.132716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.140251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: UNINITIALIZED for 2s [ 634.141808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 634.234800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7803898b-69e4-4d33-860f-8dbb01043ade: rpc.has_security_group_logging(os_id): False [ 634.262195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.262195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.262195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.262619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.262619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.262796] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.263274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.263274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.263274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.263274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.263518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.263619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.263686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.263858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.263922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.264032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be created. [ 634.336291] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.336461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.336501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.336911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.336911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.360288] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 635.857214] env[65319]: INFO networking_nsxv3.common.synchronization [None req-22cceeca-1419-45b7-8f40-3584c9447148 None None] Enqueued Resource ID: 8487b5eb-99cc-491e-94ca-0e47920866e6 with Priority: HIGHEST for action port [ 635.858878] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8487b5eb-99cc-491e-94ca-0e47920866e6 with Priority: HIGHEST for action port [ 635.860141] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8487b5eb-99cc-491e-94ca-0e47920866e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.860141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8487b5eb-99cc-491e-94ca-0e47920866e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.860141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8487b5eb-99cc-491e-94ca-0e47920866e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.860392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8487b5eb-99cc-491e-94ca-0e47920866e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.860392] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8487b5eb-99cc-491e-94ca-0e47920866e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.158970] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 636.159252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.160174] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 636.160396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.160628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.161966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.161966] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.161966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.161966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.161966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.161966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.161966] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.162849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.163977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.163977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.163977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.163977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.163977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.163977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.163977] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.239545] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b9524b52-f171-476b-ac2b-342bb757b2c1 None None] Enqueued Resource ID: b600bcb1-a99e-4205-8312-95f2cfe374da with Priority: HIGHEST for action port [ 636.241395] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b600bcb1-a99e-4205-8312-95f2cfe374da with Priority: HIGHEST for action port [ 636.241819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b600bcb1-a99e-4205-8312-95f2cfe374da taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.241954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b600bcb1-a99e-4205-8312-95f2cfe374da" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.242056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b600bcb1-a99e-4205-8312-95f2cfe374da" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.242315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b600bcb1-a99e-4205-8312-95f2cfe374da" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.242396] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b600bcb1-a99e-4205-8312-95f2cfe374da',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.362945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8487b5eb-99cc-491e-94ca-0e47920866e6 [ 636.363191] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.363526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.363621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.363856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.363946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.364052] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8487b5eb-99cc-491e-94ca-0e47920866e6 already deleted. [ 636.364134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8487b5eb-99cc-491e-94ca-0e47920866e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.374263] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 636.374471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.374671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.374886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.374985] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.665929] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.673629] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.749826] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b600bcb1-a99e-4205-8312-95f2cfe374da [ 636.751834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.751834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.751834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.751834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.751834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.751834] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b600bcb1-a99e-4205-8312-95f2cfe374da already deleted. [ 636.751834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b600bcb1-a99e-4205-8312-95f2cfe374da" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.880093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.880426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.880426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.882025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.882025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.882025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.882025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.882328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.882370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.882508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.882969] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.172415] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.177030] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.387188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.387369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.387458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.387687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.387864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.387965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.388041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.388222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.388276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.388374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.388515] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.388608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.388673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.388814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.389302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.389302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.389302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.389302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.389302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.389663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.389663] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 637.626650] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 637.627828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.631020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.631020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.631020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.631020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.631020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.675292] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.675910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.676121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.677032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.677032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.677032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 637.680137] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_rules [ 637.680137] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 637.681027] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_rules [ 637.681027] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 637.681027] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 637.681027] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 637.681027] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c0106a2-467b-42dd-938b-70b117b7e73b req-209aa6c9-739f-41a0-bfd6-55574b95900f tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 637.681809] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.681939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.682064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.682178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.682249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.682380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be updated. [ 637.683473] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_rules [ 637.683686] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_rules [ 637.683787] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 637.683867] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 with Priority: HIGHEST for action port [ 637.683959] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 637.684063] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 637.684147] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 637.685241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.685441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.686013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.686013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.686013] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.686993] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.687207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.687288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.687377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.687558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4563eadd-f19d-4a01-b309-a68ae078bc67 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.687661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.687721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.687908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.687987] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4563eadd-f19d-4a01-b309-a68ae078bc67',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.689749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.689749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.689749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.689749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.689749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.689749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.727045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.727268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.727268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.727490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.727616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.729799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.729960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.730012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.730267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.730404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.741541] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 637.742633] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 637.894962] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7803898b-69e4-4d33-860f-8dbb01043ade: rpc.has_security_group_logging(os_id): False [ 637.915376] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.916683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.916683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.916683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.917085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.917833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.918081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.918260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.918876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.919065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.920209] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.920702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.920702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.921125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.921345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.921836] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.921962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.922132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.922608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.922782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.922987] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 637.969542] env[65319]: INFO networking_nsxv3.common.synchronization [None req-dcb0da3b-7050-4c22-a2a0-f688ca918cbc tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 637.970433] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 637.971623] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.971623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.971855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.972046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.972307] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.005962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.006184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.006321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.006452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.006595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.022944] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 638.133688] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.191468] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.191720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.191896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4563eadd-f19d-4a01-b309-a68ae078bc67 with status ACTIVE [ 638.192168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.192272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.192340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.192567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.192725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.193036] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.193036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.193194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.193317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.193388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.193650] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.193748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.193833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.194097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.195186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.195329] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4563eadd-f19d-4a01-b309-a68ae078bc67 is going to be updated. [ 638.240519] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.240761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.240875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.241178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.241354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.241645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4563eadd-f19d-4a01-b309-a68ae078bc67" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.494766] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.494943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.494943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.495120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.495213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.495329] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc already deleted. [ 638.495432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.637274] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.686658] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5df4dbc2-d62e-4be7-831a-3ca7ace7386f None None] Enqueued Resource ID: 6c1def30-1736-4430-b4b2-1befedd370dc with Priority: HIGHEST for action port [ 638.687343] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c1def30-1736-4430-b4b2-1befedd370dc with Priority: HIGHEST for action port [ 638.688325] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c1def30-1736-4430-b4b2-1befedd370dc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.688601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c1def30-1736-4430-b4b2-1befedd370dc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.688756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c1def30-1736-4430-b4b2-1befedd370dc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.688953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c1def30-1736-4430-b4b2-1befedd370dc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.689083] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c1def30-1736-4430-b4b2-1befedd370dc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.776121] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b2b078b3-b51c-4413-8eb6-38473a165c57 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 638.776121] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 638.776121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.776121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.776121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.776121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.776121] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.141234] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.141628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.141628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.141793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.141892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.141990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c is going to be created. [ 639.169989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.173840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.173840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.173840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.173840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.184682] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: UNINITIALIZED for 2s [ 639.192392] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c1def30-1736-4430-b4b2-1befedd370dc [ 639.192734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.192887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.192955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.193203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.193295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.193388] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c1def30-1736-4430-b4b2-1befedd370dc already deleted. [ 639.193469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c1def30-1736-4430-b4b2-1befedd370dc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.299399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.299593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.299593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.299768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.299863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.300015] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc already deleted. [ 639.300905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.350020] env[65319]: INFO networking_nsxv3.common.synchronization [req-cbb23828-809e-438d-a402-338d2f0d0800 req-ad5f10ef-9ddc-4dab-a57e-65d9330b9525 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 639.350020] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 639.350020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.350020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.350020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.350020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.350020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.350020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.350020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.351911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.353640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.355797] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.584770] env[65319]: INFO networking_nsxv3.common.synchronization [None req-37727e18-8c6e-46a2-aad5-5a08bf7f5cd4 None None] Enqueued Resource ID: 62ef168f-9f47-4879-89f7-f4a5ce17dcf4 with Priority: HIGHEST for action port [ 639.585430] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ef168f-9f47-4879-89f7-f4a5ce17dcf4 with Priority: HIGHEST for action port [ 639.585827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-62ef168f-9f47-4879-89f7-f4a5ce17dcf4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.585975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62ef168f-9f47-4879-89f7-f4a5ce17dcf4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.586796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62ef168f-9f47-4879-89f7-f4a5ce17dcf4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.587138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62ef168f-9f47-4879-89f7-f4a5ce17dcf4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.587224] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62ef168f-9f47-4879-89f7-f4a5ce17dcf4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.736449] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.736662] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.736766] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.737586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.737586] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.737586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.738521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.738521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.738521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.738521] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.738521] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.738521] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.738828] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.738828] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.738828] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.738974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.755747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 639.756060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.756596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.756797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.757116] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.757116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.759185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.759185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759185] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.760634] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 639.760634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.760752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.760930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.762422] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.762422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.762422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.762422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.762422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.762422] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.763926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.763926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.765103] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.765103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.765103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.765103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.765103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.765103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.765103] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.771136] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.771308] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.771450] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.771818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.772146] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-4e5448ab-b006-4005-b57e-ae2461e8021b taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.772146] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.772420] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.772610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.773229] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5448ab-b006-4005-b57e-ae2461e8021b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.774719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.774918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.775147] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.775337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.775410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.775591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.775728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.775798] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.857575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.857776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.857841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.859077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.859077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.859077] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.859077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.859077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.859449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.859449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.859449] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa already deleted. [ 639.859449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.042296] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 640.042488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.092324] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62ef168f-9f47-4879-89f7-f4a5ce17dcf4 [ 640.093067] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.093067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.093067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.093613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.093613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.093613] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62ef168f-9f47-4879-89f7-f4a5ce17dcf4 already deleted. [ 640.093797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62ef168f-9f47-4879-89f7-f4a5ce17dcf4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.270860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.270860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.275469] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.278479] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.278479] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.278725] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.279157] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.280518] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.280518] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 4e5448ab-b006-4005-b57e-ae2461e8021b not found, creating... [ 640.280518] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.280518] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.280518] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.280883] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.280883] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.281616] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.282021] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.282205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.282389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.282630] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.282750] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 4e5448ab-b006-4005-b57e-ae2461e8021b is going to be created. [ 640.284628] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.285588] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.306883] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.307148] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.307277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.307544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.307928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.308198] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.778921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.788456] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73bd0d96-c37a-417f-a9ec-9f3f59a6889c: rpc.has_security_group_logging(os_id): False [ 640.789662] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.813476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.813769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.814757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.814896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.815083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.815416] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.815714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.816623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.816623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.816623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.816623] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be created. [ 640.881933] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.882159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.882159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.882577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.882790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.896715] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 641.161327] env[65319]: INFO networking_nsxv3.common.synchronization [req-cbb23828-809e-438d-a402-338d2f0d0800 req-81ca55b2-54cc-465f-8180-1e9d946fbbe4 service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 641.161671] env[65319]: INFO networking_nsxv3.common.synchronization [req-cbb23828-809e-438d-a402-338d2f0d0800 req-81ca55b2-54cc-465f-8180-1e9d946fbbe4 service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 641.163799] env[65319]: INFO networking_nsxv3.common.synchronization [req-cbb23828-809e-438d-a402-338d2f0d0800 req-81ca55b2-54cc-465f-8180-1e9d946fbbe4 service nova] Enqueued Resource ID: 4e5448ab-b006-4005-b57e-ae2461e8021b with Priority: HIGHEST for action port [ 641.165585] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 641.165585] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 641.165585] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e5448ab-b006-4005-b57e-ae2461e8021b with Priority: HIGHEST for action port [ 641.165585] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.165585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.165585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.165853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.165853] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.166792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.166923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.166990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.167207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.167360] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.167847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.167964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.168890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.168890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.168890] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.169625] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e5448ab-b006-4005-b57e-ae2461e8021b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.169751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.169827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.170218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.170218] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5448ab-b006-4005-b57e-ae2461e8021b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.197471] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: SUCCESS [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.199561] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.199561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.200090] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.284207] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.284207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.284613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.284613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.284613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.284708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 641.293698] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.295108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.295108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.295108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.295108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.295108] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be updated. [ 641.321029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.321204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.321251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.321749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.321749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.324363] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.324602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.324944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.326245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.326580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.335874] env[65319]: INFO networking_nsxv3.common.synchronization [req-49fc7eca-4de5-45f4-b1b0-a481c9f922f5 req-590279b7-cce0-4e9e-85b6-4e38483616e4 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 641.336536] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 641.337073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.337073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.337230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.337834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.337834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.337834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.337834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.337834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.338090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.338090] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.343499] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 641.345654] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 641.674939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.674939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.675936] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.676481] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e5448ab-b006-4005-b57e-ae2461e8021b with status ACTIVE [ 641.679151] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.679151] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.679565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.679565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.679565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.679565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.679727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.680560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.680659] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e5448ab-b006-4005-b57e-ae2461e8021b is going to be updated. [ 641.704274] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.709132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.709296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.709361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.709592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.709734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.709903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e5448ab-b006-4005-b57e-ae2461e8021b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.780796] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.780796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.780796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.781116] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.781416] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.781605] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.781708] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.781944] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.782097] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.782310] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.782417] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.782523] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.782645] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.782807] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.782922] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.783069] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.823912] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.824120] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.824255] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.825030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.825030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-b1dc5644-29ea-446f-bec9-29cc996ca464 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.825224] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.825224] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.825988] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.825988] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1dc5644-29ea-446f-bec9-29cc996ca464',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.840834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.841263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.841263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.841669] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.841811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.841811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.842601] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 already deleted. [ 641.842601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.184780] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.208367] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.331173] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.331453] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.331453] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.331587] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.332075] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.332075] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port b1dc5644-29ea-446f-bec9-29cc996ca464 not found, creating... [ 642.332244] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.332409] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.332528] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.332793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.332932] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.333236] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.333386] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.333496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.333734] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.334190] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.334420] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: b1dc5644-29ea-446f-bec9-29cc996ca464 is going to be created. [ 642.360351] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.360440] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.361807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.361807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.361807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.361807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.686907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.687458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.687458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.687458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.687458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.687718] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be created. [ 642.711079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.711287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.711364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.711599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.711695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.711834] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c is going to be updated. [ 642.719244] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.719505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.719505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.719599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.719724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.732175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: UNINITIALIZED for 2s [ 642.750024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.750024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.750024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.750024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.750024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.761042] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: IN_PROGRESS for 2s [ 642.916953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 642.916953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.916953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.916953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.916953] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.057859] env[65319]: INFO networking_nsxv3.common.synchronization [None req-77016ba3-eeba-4205-b368-a2ba7a03acd6 None None] Enqueued Resource ID: afb04b23-9769-4769-85ac-10a99ab17332 with Priority: HIGHEST for action port [ 643.057859] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb04b23-9769-4769-85ac-10a99ab17332 with Priority: HIGHEST for action port [ 643.058258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb04b23-9769-4769-85ac-10a99ab17332 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.058476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb04b23-9769-4769-85ac-10a99ab17332" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.058985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb04b23-9769-4769-85ac-10a99ab17332" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.058985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb04b23-9769-4769-85ac-10a99ab17332" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.059677] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb04b23-9769-4769-85ac-10a99ab17332',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.159877] env[65319]: INFO networking_nsxv3.common.synchronization [req-49fc7eca-4de5-45f4-b1b0-a481c9f922f5 req-f2618ddd-55c4-4923-8d29-d8e308a7a60d service nova] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 643.159877] env[65319]: INFO networking_nsxv3.common.synchronization [req-49fc7eca-4de5-45f4-b1b0-a481c9f922f5 req-f2618ddd-55c4-4923-8d29-d8e308a7a60d service nova] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 643.159877] env[65319]: INFO networking_nsxv3.common.synchronization [req-49fc7eca-4de5-45f4-b1b0-a481c9f922f5 req-f2618ddd-55c4-4923-8d29-d8e308a7a60d service nova] Enqueued Resource ID: b1dc5644-29ea-446f-bec9-29cc996ca464 with Priority: HIGHEST for action port [ 643.160762] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 643.160877] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 643.161053] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dc5644-29ea-446f-bec9-29cc996ca464 with Priority: HIGHEST for action port [ 643.161437] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.161611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.161668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.161956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.161956] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.163768] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.163768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.163768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.163960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.164150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.164327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.164394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.164566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.164665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.164787] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.169579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1dc5644-29ea-446f-bec9-29cc996ca464 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.169579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.169579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.169579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.169579] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1dc5644-29ea-446f-bec9-29cc996ca464',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.357511] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 643.357511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.358724] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 643.358724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.358724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.358894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.359141] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.360095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.360095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.360095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.360095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.360095] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.361109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.361613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.361706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.361825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.361891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.362141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.362277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.362381] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.421823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.422063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.562934] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afb04b23-9769-4769-85ac-10a99ab17332 [ 643.562934] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.564027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.564027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.564027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.564027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.564027] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afb04b23-9769-4769-85ac-10a99ab17332 already deleted. [ 643.564454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb04b23-9769-4769-85ac-10a99ab17332" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.665979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.665979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.667024] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.669780] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1dc5644-29ea-446f-bec9-29cc996ca464 with status ACTIVE [ 643.669780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.669780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.669780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.669780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.671744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.671744] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.671744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.671744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.671744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.671744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.671744] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.672312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.672312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.673242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.673242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.673242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1dc5644-29ea-446f-bec9-29cc996ca464 is going to be updated. [ 643.696336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.696516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.696516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.696748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.697431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.697431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1dc5644-29ea-446f-bec9-29cc996ca464" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.844666] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8ef71a1b-710b-4055-b1b6-508b36a5d344 None None] Enqueued Resource ID: 58ef78a3-0d31-4fe0-8469-ce5093e5c1f2 with Priority: HIGHEST for action port [ 643.844666] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58ef78a3-0d31-4fe0-8469-ce5093e5c1f2 with Priority: HIGHEST for action port [ 643.845073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-58ef78a3-0d31-4fe0-8469-ce5093e5c1f2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.845073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58ef78a3-0d31-4fe0-8469-ce5093e5c1f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.845073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58ef78a3-0d31-4fe0-8469-ce5093e5c1f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.846385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58ef78a3-0d31-4fe0-8469-ce5093e5c1f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.846385] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58ef78a3-0d31-4fe0-8469-ce5093e5c1f2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.864709] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.866043] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.175666] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.348261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58ef78a3-0d31-4fe0-8469-ce5093e5c1f2 [ 644.348261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.348261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.348261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.348482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.348482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.348545] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58ef78a3-0d31-4fe0-8469-ce5093e5c1f2 already deleted. [ 644.349387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58ef78a3-0d31-4fe0-8469-ce5093e5c1f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.368991] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.369960] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.679576] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.679576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.679576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.679866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.679994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.680167] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be created. [ 644.707169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.707355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.707422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.707602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.707767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.717986] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: UNINITIALIZED for 2s [ 644.743098] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 644.743190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.743343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.743610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.743820] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.743943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.744027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.744282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.744529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.744529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.744793] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.778432] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: SUCCESS [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.778432] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.778432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.778432] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.872607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.872787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.872859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.873114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.873255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.873317] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be updated. [ 644.876172] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.876172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.876172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.876172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.876401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.876448] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 644.906829] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.907092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.907167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.908036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.908036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.910057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.910171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.910246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.910429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.910635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.921860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 644.922653] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 645.249502] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.281437] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.751681] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa: rpc.has_security_group_logging(os_id): False [ 645.773605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.773605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.773605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.775058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.775058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.775592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.775592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.775592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.775726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.776333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.776447] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be created. [ 645.785682] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53a1e5a3-4b59-400c-b2d3-35a9514b015c: rpc.has_security_group_logging(os_id): False [ 645.812353] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.812557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.812790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.812900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.812943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.813437] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.813437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.813437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.813626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.813626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.814177] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c is going to be created. [ 645.897821] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.898277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.898363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.898619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.898861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.900873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.901062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.901135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.901351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.901613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.926731] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 645.926731] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: IN_PROGRESS for 2s [ 646.573063] env[65319]: INFO networking_nsxv3.common.synchronization [req-05e2259e-dfeb-4c48-a236-78b3c49fbea2 req-464d5b3a-98be-487e-b93c-4b7040c7a321 tempest-ServerExternalEventsTest-1872843560 tempest-ServerExternalEventsTest-1872843560-project-member] Enqueued Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 646.573590] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 646.573903] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.574038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.574306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.574589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.574717] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.574891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.575197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.575513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.575611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.575716] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.736450] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: UNINITIALIZED for 4s [ 646.938368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.938368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.938368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.938368] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.939717] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 646.939888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.940046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.940228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.940401] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.942106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.942106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.942106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.942106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.942106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.942307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.942833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.942918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.943065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.943984] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.944120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.944228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.944392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.944494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.944619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.947750] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.080516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080516] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 already deleted. [ 647.080516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.249249] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.249400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.249580] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.249772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.250037] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.250193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.250298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.250510] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.250646] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.250847] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.250952] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.251085] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.251190] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.251293] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.251391] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.251515] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.271824] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.271975] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.272094] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.272266] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.272821] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5ef5a514-53a9-4291-a849-192129ec17b1 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.272941] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.272980] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.273283] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.273415] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ef5a514-53a9-4291-a849-192129ec17b1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.449436] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.449436] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 647.467247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.467247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.467247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.467672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.467818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.467818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.467894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.468944] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.468944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.468944] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 647.535102] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.535233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.535331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.535504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.535650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.552619] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 647.778398] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.779038] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.779038] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.779284] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.779485] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.779725] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 5ef5a514-53a9-4291-a849-192129ec17b1 not found, creating... [ 647.780148] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.780400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.780544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.780845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.781124] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.781446] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.781643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.781823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.782028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.782182] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.782352] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5ef5a514-53a9-4291-a849-192129ec17b1 is going to be created. [ 647.803347] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.803609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.803733] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.804113] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.804299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.804437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.945102] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: SUCCESS [ 647.945102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.946265] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 647.947370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.949801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73bd0d96-c37a-417f-a9ec-9f3f59a6889c: rpc.has_security_group_logging(os_id): False [ 647.973889] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.974104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.974209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.974459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.974879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.975032] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.975261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.975261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.975497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.975621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.975726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be updated. [ 648.029386] env[65319]: INFO networking_nsxv3.common.synchronization [None req-83feaa00-49b2-4dcb-b61b-0e9d5744a610 None None] Enqueued Resource ID: ad28bc5d-0df8-4052-acc0-b99d68961f45 with Priority: HIGHEST for action port [ 648.029954] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad28bc5d-0df8-4052-acc0-b99d68961f45 with Priority: HIGHEST for action port [ 648.030287] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad28bc5d-0df8-4052-acc0-b99d68961f45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.030435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad28bc5d-0df8-4052-acc0-b99d68961f45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.030526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad28bc5d-0df8-4052-acc0-b99d68961f45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.030724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad28bc5d-0df8-4052-acc0-b99d68961f45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.030813] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad28bc5d-0df8-4052-acc0-b99d68961f45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.050444] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.050643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.050691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.050915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.051117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.065504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 648.522391] env[65319]: INFO networking_nsxv3.common.synchronization [req-05e2259e-dfeb-4c48-a236-78b3c49fbea2 req-4d72ca90-5aed-4b7c-b588-f91d3f662551 service nova] Enqueued Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_rules [ 648.522467] env[65319]: INFO networking_nsxv3.common.synchronization [req-05e2259e-dfeb-4c48-a236-78b3c49fbea2 req-4d72ca90-5aed-4b7c-b588-f91d3f662551 service nova] Enqueued Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 648.522602] env[65319]: INFO networking_nsxv3.common.synchronization [req-05e2259e-dfeb-4c48-a236-78b3c49fbea2 req-4d72ca90-5aed-4b7c-b588-f91d3f662551 service nova] Enqueued Resource ID: 5ef5a514-53a9-4291-a849-192129ec17b1 with Priority: HIGHEST for action port [ 648.523161] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_rules [ 648.523292] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 648.523876] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ef5a514-53a9-4291-a849-192129ec17b1 with Priority: HIGHEST for action port [ 648.523876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.523876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.524126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.525105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.525105] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.526218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.526218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.526218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.526218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.526218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.526218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.526218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.526522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.526522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.526522] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.527271] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ef5a514-53a9-4291-a849-192129ec17b1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.528170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.528170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.528282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.528282] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ef5a514-53a9-4291-a849-192129ec17b1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.537038] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad28bc5d-0df8-4052-acc0-b99d68961f45 [ 648.537211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.538489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.538489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.538489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.538489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.538489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad28bc5d-0df8-4052-acc0-b99d68961f45 already deleted. [ 648.538489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad28bc5d-0df8-4052-acc0-b99d68961f45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.749035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 648.749412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.749528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.751476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.751476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.751476] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.030690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.030690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.030690] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.031431] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ef5a514-53a9-4291-a849-192129ec17b1 with status ACTIVE [ 649.031581] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.031756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.031839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.032144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.032444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.032752] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.032752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.032844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.033919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.033919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.033919] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ef5a514-53a9-4291-a849-192129ec17b1 is going to be updated. [ 649.058710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.058710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.058710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.058710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.058710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.058710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ef5a514-53a9-4291-a849-192129ec17b1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.194584] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d96626df-07b4-4925-846c-28bf53c20235 None None] Enqueued Resource ID: 47878b27-dd7c-4e00-8d45-1b709ed014b6 with Priority: HIGHEST for action port [ 649.195237] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47878b27-dd7c-4e00-8d45-1b709ed014b6 with Priority: HIGHEST for action port [ 649.195584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-47878b27-dd7c-4e00-8d45-1b709ed014b6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.195718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47878b27-dd7c-4e00-8d45-1b709ed014b6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.195787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47878b27-dd7c-4e00-8d45-1b709ed014b6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.196103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47878b27-dd7c-4e00-8d45-1b709ed014b6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.196190] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47878b27-dd7c-4e00-8d45-1b709ed014b6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.257311] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.538273] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.568063] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 649.568323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.568494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.568720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.568813] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.698095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47878b27-dd7c-4e00-8d45-1b709ed014b6 [ 649.698843] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.698843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.698843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.698843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.698843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.699329] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47878b27-dd7c-4e00-8d45-1b709ed014b6 already deleted. [ 649.699329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47878b27-dd7c-4e00-8d45-1b709ed014b6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.759884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0: rpc.has_security_group_logging(os_id): False [ 649.787507] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.788383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.788633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.788671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.789613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.789613] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.789613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.789613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.789613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.789613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.789613] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be created. [ 649.863395] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.863395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.863661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.863720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.863873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.875978] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 650.040530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.040896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.040896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.040989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.041149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.042661] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 is going to be created. [ 650.070054] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.072156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.072156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.072156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.072156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.073240] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.073370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.073439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.073701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.073874] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.073973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.074066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.074230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.074482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.074482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.074482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.094909] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: UNINITIALIZED for 2s [ 650.099668] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 650.099668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.341768] env[65319]: INFO networking_nsxv3.common.synchronization [None req-48bde0fa-2ac2-47e7-b282-3ef5b94b6723 None None] Enqueued Resource ID: 677c00c1-7017-47b3-a9c8-1c8be0770162 with Priority: HIGHEST for action port [ 650.341768] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677c00c1-7017-47b3-a9c8-1c8be0770162 with Priority: HIGHEST for action port [ 650.343299] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-677c00c1-7017-47b3-a9c8-1c8be0770162 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.344817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677c00c1-7017-47b3-a9c8-1c8be0770162" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.344817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677c00c1-7017-47b3-a9c8-1c8be0770162" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.344817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677c00c1-7017-47b3-a9c8-1c8be0770162" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.344817] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677c00c1-7017-47b3-a9c8-1c8be0770162',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.577656] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.577818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.577888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.578243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.578328] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.578494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.578494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.578646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.578732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.578821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.578967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.579075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.579136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.579278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.579476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.579560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.579560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.579692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.579766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.579845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.579929] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.643688] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ac944d7d-27b4-4733-838e-1bb3d96e9198 None None] Enqueued Resource ID: d0448736-61a5-4c5c-9ba2-46861f496858 with Priority: HIGHEST for action port [ 650.644257] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0448736-61a5-4c5c-9ba2-46861f496858 with Priority: HIGHEST for action port [ 650.644522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0448736-61a5-4c5c-9ba2-46861f496858 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.644699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0448736-61a5-4c5c-9ba2-46861f496858" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.644699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0448736-61a5-4c5c-9ba2-46861f496858" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.646827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0448736-61a5-4c5c-9ba2-46861f496858" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.648105] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0448736-61a5-4c5c-9ba2-46861f496858',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.847131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 677c00c1-7017-47b3-a9c8-1c8be0770162 [ 650.847434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.847571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.847637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.847931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.848051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.848184] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:677c00c1-7017-47b3-a9c8-1c8be0770162 already deleted. [ 650.848397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677c00c1-7017-47b3-a9c8-1c8be0770162" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.082742] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 651.106718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.106718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.106718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.106718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.106718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.107115] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.107115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.107115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.107301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.107301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.107372] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.107700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.107700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.110193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.110333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.110547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.110652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.110718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.110885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.111055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.111095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 651.151170] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0448736-61a5-4c5c-9ba2-46861f496858 [ 651.151170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.151170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.151170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.151170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.151170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.151170] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0448736-61a5-4c5c-9ba2-46861f496858 already deleted. [ 651.151170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0448736-61a5-4c5c-9ba2-46861f496858" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.171444] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.171630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.171688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.171872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.172027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.188538] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 651.777121] env[65319]: INFO networking_nsxv3.common.synchronization [req-21d5cc16-cd02-41a4-970f-911ddfd8e884 req-ed1804bf-0ebe-47c2-bbeb-7eb563e1d8ed tempest-DeleteServersAdminTestJSON-985890744 tempest-DeleteServersAdminTestJSON-985890744-project-member] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 651.777121] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 651.777121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.777121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.777121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.777121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.777402] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.777402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.781070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.781362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.781439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.781505] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.886842] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 651.887078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.107936] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: SUCCESS [ 652.109903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.109903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.110285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.110285] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.110285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.110427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.110549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.110595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.110668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.110766] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.284553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.285253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.285253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.285521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.285521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.285769] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.285920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.286060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.286387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.286387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.286554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be updated. [ 652.314312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.314539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.314662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.314935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.315141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.328082] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 652.396874] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.397252] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.397482] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.397858] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.398275] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.398531] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.398766] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.399064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.399999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.400348] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.400588] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.400682] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.401113] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.401113] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.401270] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.401610] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.424228] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.424228] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.424228] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.424435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.424682] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-43f091da-2ef1-4850-8613-d6022f66ae3e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.424861] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.425062] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.425417] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.425606] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43f091da-2ef1-4850-8613-d6022f66ae3e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.613216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.614387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.614387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.614387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.614755] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.614755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.614755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.614880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.614880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.614942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.615619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.615619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.615619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.615619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.615619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.615619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.616189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.616189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.616189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.616189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.616189] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.929843] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.930217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.930401] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.931324] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.931595] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.932054] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 43f091da-2ef1-4850-8613-d6022f66ae3e not found, creating... [ 652.932385] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.933803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.933967] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.938115] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.938115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.938115] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 43f091da-2ef1-4850-8613-d6022f66ae3e is going to be created. [ 652.960257] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.963465] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.963465] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.963465] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.963465] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.963465] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.120822] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 227caa4e-22f8-4b1d-a23b-fe01278d6b18: rpc.has_security_group_logging(os_id): False [ 653.142656] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.142847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.142971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.143226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.143430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.143665] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.144195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.144195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.144195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.144195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.146259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.146353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.146474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.146605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.146752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.147024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.147108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.147187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.147570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.147570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.147570] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 is going to be created. [ 653.202577] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 653.203146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.211570] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.211747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.211835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.212069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.212285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.222624] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: IN_PROGRESS for 2s [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [req-21d5cc16-cd02-41a4-970f-911ddfd8e884 req-24a0b36a-3c7d-4552-8bc3-7d238854c5d7 service nova] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_rules [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [req-21d5cc16-cd02-41a4-970f-911ddfd8e884 req-24a0b36a-3c7d-4552-8bc3-7d238854c5d7 service nova] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [req-21d5cc16-cd02-41a4-970f-911ddfd8e884 req-24a0b36a-3c7d-4552-8bc3-7d238854c5d7 service nova] Enqueued Resource ID: 43f091da-2ef1-4850-8613-d6022f66ae3e with Priority: HIGHEST for action port [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_rules [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 653.698347] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43f091da-2ef1-4850-8613-d6022f66ae3e with Priority: HIGHEST for action port [ 653.698347] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.701966] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.701966] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.701966] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-43f091da-2ef1-4850-8613-d6022f66ae3e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.701966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.701966] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43f091da-2ef1-4850-8613-d6022f66ae3e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.727088] env[65319]: INFO networking_nsxv3.common.synchronization [None req-310852ac-ba58-4b6b-b711-45985f9f2609 None None] Enqueued Resource ID: 82934bb1-ed73-4117-9f90-ab702bb31046 with Priority: HIGHEST for action port [ 653.729108] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82934bb1-ed73-4117-9f90-ab702bb31046 with Priority: HIGHEST for action port [ 653.729108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-82934bb1-ed73-4117-9f90-ab702bb31046 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.729108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82934bb1-ed73-4117-9f90-ab702bb31046" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.729108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82934bb1-ed73-4117-9f90-ab702bb31046" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.729108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82934bb1-ed73-4117-9f90-ab702bb31046" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.729108] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82934bb1-ed73-4117-9f90-ab702bb31046',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.890437] env[65319]: INFO networking_nsxv3.common.synchronization [req-bfce42e2-2d6b-474d-911c-3e156fc811ce req-a7d42d3e-6163-48cf-8bf8-ab0e441175b3 tempest-ImagesOneServerTestJSON-388707046 tempest-ImagesOneServerTestJSON-388707046-project-member] Enqueued Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 653.891874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 653.892183] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.892281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.892362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.892605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.892776] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.892882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.892944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.893119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.893205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.893305] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.209647] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.209647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.209647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43f091da-2ef1-4850-8613-d6022f66ae3e with status ACTIVE [ 654.209647] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.209647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.209647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.209647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.209647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.209647] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.210585] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.210585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.210845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.210845] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43f091da-2ef1-4850-8613-d6022f66ae3e is going to be updated. [ 654.231489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82934bb1-ed73-4117-9f90-ab702bb31046 [ 654.231811] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.231953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.232032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.232242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.232333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.232427] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82934bb1-ed73-4117-9f90-ab702bb31046 already deleted. [ 654.232508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82934bb1-ed73-4117-9f90-ab702bb31046" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.235521] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.235655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.235718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.235951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.236106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.236303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43f091da-2ef1-4850-8613-d6022f66ae3e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.337865] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 654.337865] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e deletion is rescheduled due to dependency. [ 654.338069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.338250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.338416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.338619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.338741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.338802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.338979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.339210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.339210] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.395667] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.395758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.395835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.396234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.396787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.397011] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.397136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.397200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.397378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.397538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.397538] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 already deleted. [ 654.397648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.403635] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.403635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-106" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.403635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-106" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.404260] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-106" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.404791] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.406491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.406491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.406491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.406491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.406491] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.406491] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.406491] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.406491] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.406491] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.406491] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.406962] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.429261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.429261] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.429261] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.429417] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-106" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.429671] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-55192a30-f240-43b8-a66a-7df4e28508f2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.429842] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.429958] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.430626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.430837] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55192a30-f240-43b8-a66a-7df4e28508f2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.842371] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.885682] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7998c88a-daf9-4e26-a178-54e9e2b7ecc0 None None] Enqueued Resource ID: 75ac3650-8088-48f5-bf59-af184feb6351 with Priority: HIGHEST for action port [ 654.886249] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ac3650-8088-48f5-bf59-af184feb6351 with Priority: HIGHEST for action port [ 654.886599] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-75ac3650-8088-48f5-bf59-af184feb6351 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.886772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75ac3650-8088-48f5-bf59-af184feb6351" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.886850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75ac3650-8088-48f5-bf59-af184feb6351" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.887989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75ac3650-8088-48f5-bf59-af184feb6351" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.888097] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75ac3650-8088-48f5-bf59-af184feb6351',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.933459] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.933750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.933886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.934191] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.934336] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.934482] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 55192a30-f240-43b8-a66a-7df4e28508f2 not found, creating... [ 654.934808] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.934970] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.935098] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.935325] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.935456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.935732] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.935881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.935991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.936206] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.936347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.936479] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 55192a30-f240-43b8-a66a-7df4e28508f2 is going to be created. [ 654.958440] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.958655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.958776] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.959051] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.959274] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.959491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.237599] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: SUCCESS [ 655.238060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.346486] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.391241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75ac3650-8088-48f5-bf59-af184feb6351 [ 655.392401] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.392401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.392401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.393279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.393279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.393279] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75ac3650-8088-48f5-bf59-af184feb6351 already deleted. [ 655.393279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75ac3650-8088-48f5-bf59-af184feb6351" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.470492] env[65319]: INFO networking_nsxv3.common.synchronization [req-0b4a2279-58ec-4281-bb5f-aa9200791af1 req-e4a74d39-e048-4cd6-abba-b1930b9836e7 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 655.471047] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 655.471367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.471492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.471555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474390] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.474606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.475073] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.682192] env[65319]: INFO networking_nsxv3.common.synchronization [req-bfce42e2-2d6b-474d-911c-3e156fc811ce req-a2f57628-bd5b-447f-b9f7-4c5718fc7b85 service nova] Enqueued Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_rules [ 655.682377] env[65319]: INFO networking_nsxv3.common.synchronization [req-bfce42e2-2d6b-474d-911c-3e156fc811ce req-a2f57628-bd5b-447f-b9f7-4c5718fc7b85 service nova] Enqueued Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 655.683164] env[65319]: INFO networking_nsxv3.common.synchronization [req-bfce42e2-2d6b-474d-911c-3e156fc811ce req-a2f57628-bd5b-447f-b9f7-4c5718fc7b85 service nova] Enqueued Resource ID: 55192a30-f240-43b8-a66a-7df4e28508f2 with Priority: HIGHEST for action port [ 655.686455] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_rules [ 655.686455] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 655.686455] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55192a30-f240-43b8-a66a-7df4e28508f2 with Priority: HIGHEST for action port [ 655.686455] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.686455] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.686455] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.686455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.686455] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.687409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.687409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.687409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.687409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.687409] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.688672] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-55192a30-f240-43b8-a66a-7df4e28508f2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.688672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.689272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.689272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.689447] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55192a30-f240-43b8-a66a-7df4e28508f2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.849117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.849282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.849354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.849569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.849678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.849755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be updated. [ 655.883870] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.884218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.884218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.884555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.884555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.896031] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 655.977554] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.189128] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.191622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55192a30-f240-43b8-a66a-7df4e28508f2 with status ACTIVE [ 656.191870] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.191996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.192073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.192253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.192344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.192518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.192622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.192684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.192825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.192904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.193101] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.193217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.193273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.193387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.193509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.193559] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55192a30-f240-43b8-a66a-7df4e28508f2 is going to be updated. [ 656.194775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.194775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.215244] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.215663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.215663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.215663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.215891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.215924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55192a30-f240-43b8-a66a-7df4e28508f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.480137] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.692715] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.885894] env[65319]: INFO networking_nsxv3.common.synchronization [req-ae84ccf0-34f5-428a-b81e-54ca9eca6b59 req-d548fc50-bed7-4d94-91a2-617777d02522 tempest-ServerAddressesNegativeTestJSON-1352329742 tempest-ServerAddressesNegativeTestJSON-1352329742-project-member] Enqueued Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 656.888295] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 656.888295] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.888295] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.888295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.888691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.888691] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.982920] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.983398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.983398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.983398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.986768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.986768] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 657.039156] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.039270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.039270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.039831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.039831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.052677] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 657.194831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.195083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.195083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.195337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.195501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.195591] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 is going to be created. [ 657.226623] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.226802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.226910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.229239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.229706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.243148] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: UNINITIALIZED for 2s [ 657.346717] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f91e1593-8fe6-4c4c-a220-3827e0bc5abe tempest-ServersTestManualDisk-63027693 tempest-ServersTestManualDisk-63027693-project-member] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 657.347306] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 657.350803] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.351410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.351410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.351410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.351410] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.382223] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3b957e0d-42be-47ce-b2b6-7dbb45d5dca9 None None] Enqueued Resource ID: 7ea1029b-3be4-41cc-9d5f-adf693c8e4ed with Priority: HIGHEST for action port [ 657.382852] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea1029b-3be4-41cc-9d5f-adf693c8e4ed with Priority: HIGHEST for action port [ 657.386166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea1029b-3be4-41cc-9d5f-adf693c8e4ed taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.386398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea1029b-3be4-41cc-9d5f-adf693c8e4ed" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.386472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea1029b-3be4-41cc-9d5f-adf693c8e4ed" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.386757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea1029b-3be4-41cc-9d5f-adf693c8e4ed" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.386843] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea1029b-3be4-41cc-9d5f-adf693c8e4ed',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.395416] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.395416] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.395416] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 already deleted. [ 657.395416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.429209] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-167" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-167" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-167" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.429209] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.429209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.429209] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.429209] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.429209] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.429209] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.429708] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.429708] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.429708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.455254] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.455462] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.455639] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.455881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-167" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.456254] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-64e6a534-df8c-4460-80f3-76417a1c6339 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.456458] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.456597] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.458614] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.458614] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64e6a534-df8c-4460-80f3-76417a1c6339',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.526585] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f67c2f87-136d-4172-b92f-fc2323ca7105 tempest-ServersTestManualDisk-63027693 tempest-ServersTestManualDisk-63027693-project-member] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 657.527877] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 657.528250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.528361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.879194] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.879499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.879499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.879612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.879770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.879885] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 already deleted. [ 657.879885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.880114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.880462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.880462] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.892139] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ea1029b-3be4-41cc-9d5f-adf693c8e4ed [ 657.892677] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.892677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.892677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.892965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.893060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.893163] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ea1029b-3be4-41cc-9d5f-adf693c8e4ed already deleted. [ 657.893246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea1029b-3be4-41cc-9d5f-adf693c8e4ed" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.908882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 657.910355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.910355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.910542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.910745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.910846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.910906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.911086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.911171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.911257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.911347] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.961316] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.961641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.961726] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.961999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.962264] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.962432] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 64e6a534-df8c-4460-80f3-76417a1c6339 not found, creating... [ 657.962755] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.962936] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.963431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.963431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.963659] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.963854] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.964032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.964205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.964463] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.964600] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.964732] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 64e6a534-df8c-4460-80f3-76417a1c6339 is going to be created. [ 657.990653] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.991064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.991219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.991739] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.992057] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.992386] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.403855] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.404052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.404129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.404735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.404890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405042] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 already deleted. [ 658.405238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.416440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.416680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.416778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417311] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.418150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.418203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.418308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.418401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.418463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.418605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.418740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.418809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.418860] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.588454] env[65319]: INFO networking_nsxv3.common.synchronization [req-f279cb30-f849-47b8-9be4-54e81181ca47 req-db3aad95-2094-4d11-bef1-9afc199e180a tempest-VolumesAdminNegativeTest-6164972 tempest-VolumesAdminNegativeTest-6164972-project-member] Enqueued Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 658.589056] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGHEST for action security_group_members [ 658.589408] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.589539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.589616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.589849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.590019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.590613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.590613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.590613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.590613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.590613] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.764923] env[65319]: INFO networking_nsxv3.common.synchronization [req-ae84ccf0-34f5-428a-b81e-54ca9eca6b59 req-ccfe1d8a-e9f2-411d-ab7e-f9c1a6c08c2f service nova] Enqueued Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_rules [ 658.764923] env[65319]: INFO networking_nsxv3.common.synchronization [req-ae84ccf0-34f5-428a-b81e-54ca9eca6b59 req-ccfe1d8a-e9f2-411d-ab7e-f9c1a6c08c2f service nova] Enqueued Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 658.764923] env[65319]: INFO networking_nsxv3.common.synchronization [req-ae84ccf0-34f5-428a-b81e-54ca9eca6b59 req-ccfe1d8a-e9f2-411d-ab7e-f9c1a6c08c2f service nova] Enqueued Resource ID: 64e6a534-df8c-4460-80f3-76417a1c6339 with Priority: HIGHEST for action port [ 658.765059] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_rules [ 658.765189] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 658.765287] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e6a534-df8c-4460-80f3-76417a1c6339 with Priority: HIGHEST for action port [ 658.766023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.766023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.766023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.766023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.769425] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.772663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.772663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.772663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.772663] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.774928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-64e6a534-df8c-4460-80f3-76417a1c6339 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.775099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.775165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.775389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.775526] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64e6a534-df8c-4460-80f3-76417a1c6339',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.781235] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7714f193-6476-49d3-a9a6-1bc21f597d2d None None] Enqueued Resource ID: a8403dc7-4274-470f-824c-96681e41db08 with Priority: HIGHEST for action port [ 658.781910] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8403dc7-4274-470f-824c-96681e41db08 with Priority: HIGHEST for action port [ 658.782408] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8403dc7-4274-470f-824c-96681e41db08 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.782631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8403dc7-4274-470f-824c-96681e41db08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.782777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8403dc7-4274-470f-824c-96681e41db08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.783090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8403dc7-4274-470f-824c-96681e41db08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.783206] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8403dc7-4274-470f-824c-96681e41db08',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.989082] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23e179a6-db4e-4e51-ab65-7ae45a30f94e: rpc.has_security_group_logging(os_id): False [ 659.010530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.010737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.010737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.011375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.011375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.011375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.011375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.011821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.011821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.011821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.011928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.011981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.012028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.012634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.012634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.012634] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.012634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.012634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.013098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.013098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.013098] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be updated. [ 659.064267] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 659.064372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.079356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.079583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.079677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.079924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.080103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.095052] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 659.095621] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.095858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.095989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.096321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.096495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.101023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.101023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.101023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.101023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.101023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.101023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 is going to be updated. [ 659.137149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.137550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.137550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.137693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.137886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.152554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: IN_PROGRESS for 2s [ 659.256085] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: SUCCESS [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.257626] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.257626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.257626] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.278119] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64e6a534-df8c-4460-80f3-76417a1c6339 with status ACTIVE [ 659.278351] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.278553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.278553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.279566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.279566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.280062] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.280062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.280062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.280062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.280062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.280062] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64e6a534-df8c-4460-80f3-76417a1c6339 is going to be updated. [ 659.282218] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.282930] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.283789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.287383] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8403dc7-4274-470f-824c-96681e41db08 [ 659.288517] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.288517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.288517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.288517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.288517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.288517] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8403dc7-4274-470f-824c-96681e41db08 already deleted. [ 659.288517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8403dc7-4274-470f-824c-96681e41db08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.307513] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.307757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.307855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.308312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.308553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.308992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64e6a534-df8c-4460-80f3-76417a1c6339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.659918] env[65319]: INFO networking_nsxv3.common.synchronization [req-fea5feb7-d2e4-4f3e-b1d5-28ba95b3e315 req-2d46bb0d-e396-4c25-8c4d-fe1c452d38ac tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 659.660793] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 659.660923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.661017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.661068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.661827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.661827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.661827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.661827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.661827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.662227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.662227] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.761582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.761582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.761582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.761862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.765301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.765301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.765301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.765301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.765301] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.786722] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.165896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.165896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.165896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc already deleted. [ 660.165896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.191839] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.191839] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.191839] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.192372] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.192810] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.193092] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.193314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.193694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.194175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.194650] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.194862] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.194953] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.195157] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.195390] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.195622] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.196123] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.218632] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.218842] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.218984] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.219174] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.219538] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-34ac73b5-6ea9-4b67-9190-396b34b35872 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.219723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.219841] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.220554] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.220720] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ac73b5-6ea9-4b67-9190-396b34b35872',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.267763] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f60b841-0425-4faa-84ee-69be80917aa4: rpc.has_security_group_logging(os_id): False [ 660.288712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.288873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.288940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.289169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.289703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.289703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.289703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.289703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.289927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.289927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.289989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.290365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.290365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.290365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.290365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.290549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.290601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.290665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.290972] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.291034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.291115] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 is going to be created. [ 660.293943] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.294064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.294164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.294289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.294369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.294531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 is going to be created. [ 660.317753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.317961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.317961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.318210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.318367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.331180] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: UNINITIALIZED for 2s [ 660.354886] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.354886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.354886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.355084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.355217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.369709] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: IN_PROGRESS for 2s [ 660.724476] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.724961] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.725123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.725462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.725625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.725783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 34ac73b5-6ea9-4b67-9190-396b34b35872 not found, creating... [ 660.727339] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.727545] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.728414] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.728687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.728837] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.729249] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.729415] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.729531] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.729768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.729954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.730120] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 34ac73b5-6ea9-4b67-9190-396b34b35872 is going to be created. [ 660.751409] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.751716] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.751895] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.752174] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.752463] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.752684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.111368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 661.111722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.164592] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 in Status: SUCCESS [ 661.165047] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 deletion is rescheduled due to dependency. [ 661.165047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.486785] env[65319]: INFO networking_nsxv3.common.synchronization [req-fea5feb7-d2e4-4f3e-b1d5-28ba95b3e315 req-c42dc57d-3b54-4f5d-9ad0-a4d84b81665c service nova] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 661.486944] env[65319]: INFO networking_nsxv3.common.synchronization [req-fea5feb7-d2e4-4f3e-b1d5-28ba95b3e315 req-c42dc57d-3b54-4f5d-9ad0-a4d84b81665c service nova] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 661.487090] env[65319]: INFO networking_nsxv3.common.synchronization [req-fea5feb7-d2e4-4f3e-b1d5-28ba95b3e315 req-c42dc57d-3b54-4f5d-9ad0-a4d84b81665c service nova] Enqueued Resource ID: 34ac73b5-6ea9-4b67-9190-396b34b35872 with Priority: HIGHEST for action port [ 661.487669] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 661.487880] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 661.488198] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ac73b5-6ea9-4b67-9190-396b34b35872 with Priority: HIGHEST for action port [ 661.488751] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.488915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.490093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.490093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.490093] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.490425] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.490537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.490585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.491249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.491423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.491784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.491884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.492193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.492193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.492417] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.494192] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ac73b5-6ea9-4b67-9190-396b34b35872 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.494192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.494192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.494192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.494192] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ac73b5-6ea9-4b67-9190-396b34b35872',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.538997] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3fe1eb44-9e8a-44ef-a9b9-0bbeeb700a65 None None] Enqueued Resource ID: 2a6d40cb-efbe-4e3b-85aa-111a3caf5939 with Priority: HIGHEST for action port [ 661.538997] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a6d40cb-efbe-4e3b-85aa-111a3caf5939 with Priority: HIGHEST for action port [ 661.538997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a6d40cb-efbe-4e3b-85aa-111a3caf5939 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.538997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a6d40cb-efbe-4e3b-85aa-111a3caf5939" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.538997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a6d40cb-efbe-4e3b-85aa-111a3caf5939" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.538997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a6d40cb-efbe-4e3b-85aa-111a3caf5939" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.538997] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6d40cb-efbe-4e3b-85aa-111a3caf5939',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.585394] env[65319]: INFO networking_nsxv3.common.synchronization [req-3fa29d59-0329-4db9-bf78-96056fbf0c38 req-180d563a-8726-446a-b9b4-fcff32dadfdb tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 661.586794] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 661.586794] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.587728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.587853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.588098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.588290] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.588412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.588473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.589978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.589978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.589978] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.996705] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.999027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.999208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.999339] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34ac73b5-6ea9-4b67-9190-396b34b35872 with status ACTIVE [ 661.999566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.999690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.999738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.999998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.000123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.000320] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.000448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.000508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.000686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.000769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.000952] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.001069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.001114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.001276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.001655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.001757] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34ac73b5-6ea9-4b67-9190-396b34b35872 is going to be updated. [ 662.042026] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a6d40cb-efbe-4e3b-85aa-111a3caf5939 [ 662.042254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.042659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.042659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.042843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.042843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.042955] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a6d40cb-efbe-4e3b-85aa-111a3caf5939 already deleted. [ 662.042955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a6d40cb-efbe-4e3b-85aa-111a3caf5939" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.057792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.058022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.058022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.058274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.058425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.058586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ac73b5-6ea9-4b67-9190-396b34b35872" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.091870] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.092071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.092170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.092464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.093158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.093158] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.093158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.093158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.093485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.093485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.093590] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 662.168837] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.169070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.169116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.169301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.169438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.188840] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 662.341634] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: SUCCESS [ 662.341870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.342053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.342270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.342463] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.342583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.342648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.342801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.342883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.342964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.343085] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.382370] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: SUCCESS [ 662.382720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.499171] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.847898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.847898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.847898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.847898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.847898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.850285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.850285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.850285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.850285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.850285] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.008138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.008525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.008567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.009851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.009900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.010031] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be created. [ 663.045255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.045255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.045495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.047992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.047992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.060930] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: UNINITIALIZED for 2s [ 663.354685] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08b741bf-ee28-4b27-bf6a-78bf52eb3be6: rpc.has_security_group_logging(os_id): False [ 663.374765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.374765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.374765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.377018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.377018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.377734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.377979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.378171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.378347] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 is going to be created. [ 663.440950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.440950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.440950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.440950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.440950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.452976] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: IN_PROGRESS for 2s [ 664.204012] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 664.204290] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade deletion is rescheduled due to dependency. [ 664.204701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.073762] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 665.074010] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.074202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.074514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.074775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.074946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.075064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.075317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.075536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.075628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.075733] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.390373] env[65319]: INFO networking_nsxv3.common.synchronization [req-3f98a075-587c-400e-974b-0f7198dd9a53 req-dd6f695e-953c-4dc5-b4e9-6963555bc274 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 665.390734] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 665.391634] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.391634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.391634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.391634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.391866] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.391942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.392015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.392334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.392334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.392436] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.470178] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: SUCCESS [ 665.470488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.697446] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.747537] env[65319]: INFO networking_nsxv3.common.synchronization [req-63cb69d6-3868-4ad5-ab7c-1011ae2590f5 req-bdbb9ff4-cfc7-48c4-9c17-2adfb5ef33a9 tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 665.748127] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 665.748748] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.748929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.749338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.749547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.749692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.749931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.749931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.750428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.750595] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.895404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.895404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.895576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.895683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.895799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.895959] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.896077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.896130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.896271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.896342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.896423] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 665.928231] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.928589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.928589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.928706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.928780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.938983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 666.085093] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 658fe8b2-be4c-42fb-841e-f105abeb65cc: rpc.has_security_group_logging(os_id): False [ 666.110332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.110332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.110480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.110793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.110793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.111056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.111056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.111320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.111320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.111320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.111460] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be created. [ 666.184013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.184321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.184402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.184636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.184866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.198946] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 666.253540] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.253749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.253857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.254093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.254244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.254493] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.254709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.254709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.254817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.254933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.254981] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe already deleted. [ 666.255068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.374574] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.374831] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.374999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.375529] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.375886] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.376185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.376351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.376644] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.376838] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.377141] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.377297] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.377516] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.377673] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.377828] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.377973] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.378177] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.398712] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.399184] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.399184] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.399184] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.399514] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.399728] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.399819] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.400147] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.400292] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15a744f-ebd8-4367-aeb2-91d6d9120d9c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.832703] env[65319]: INFO networking_nsxv3.common.synchronization [req-e997dcbe-2522-4388-a018-c90f05511cde req-6f911928-e07a-4935-8baf-cdcab6fcb09f tempest-ServersTestFqdnHostnames-1763966681 tempest-ServersTestFqdnHostnames-1763966681-project-member] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 666.833134] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGHEST for action security_group_members [ 666.833382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.833531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.833595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.833862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.833992] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.834119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.834196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.834322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.834408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.834496] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.902468] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.902782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.902887] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.903180] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.903348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.904310] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port f15a744f-ebd8-4367-aeb2-91d6d9120d9c not found, creating... [ 666.904310] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.904310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.904310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.904310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.904603] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.904700] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.904841] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.904956] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.905173] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.905297] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.905422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: f15a744f-ebd8-4367-aeb2-91d6d9120d9c is going to be created. [ 666.929440] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.930020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.930250] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.930496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.338037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.338037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.338037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.338037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.338347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.338526] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.338632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.338719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.338940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.339082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.339293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e is going to be updated. [ 667.370093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.370093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.370093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.370093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.370093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.381200] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: IN_PROGRESS for 2s [ 667.642475] env[65319]: INFO networking_nsxv3.common.synchronization [req-63cb69d6-3868-4ad5-ab7c-1011ae2590f5 req-65f61216-bd22-4fca-91a5-0afcd5025a4f service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 667.642720] env[65319]: INFO networking_nsxv3.common.synchronization [req-63cb69d6-3868-4ad5-ab7c-1011ae2590f5 req-65f61216-bd22-4fca-91a5-0afcd5025a4f service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 667.643202] env[65319]: INFO networking_nsxv3.common.synchronization [req-63cb69d6-3868-4ad5-ab7c-1011ae2590f5 req-65f61216-bd22-4fca-91a5-0afcd5025a4f service nova] Enqueued Resource ID: f15a744f-ebd8-4367-aeb2-91d6d9120d9c with Priority: HIGHEST for action port [ 667.643379] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 667.644400] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 667.644400] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15a744f-ebd8-4367-aeb2-91d6d9120d9c with Priority: HIGHEST for action port [ 667.644400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.644400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.644400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.644400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.647831] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.647831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.647831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.647831] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.647831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.647831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.648566] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15a744f-ebd8-4367-aeb2-91d6d9120d9c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.952995] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 667.953199] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 667.953386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.152900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.152900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.152900] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.155472] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f15a744f-ebd8-4367-aeb2-91d6d9120d9c with status ACTIVE [ 668.155896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.156298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.156509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.156846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.157074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.157399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.157665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.157843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.158158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.159831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.159831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.159831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.159831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.159831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.159831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.159831] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f15a744f-ebd8-4367-aeb2-91d6d9120d9c is going to be updated. [ 668.183509] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.183786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.183990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.184210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.184360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.184540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f15a744f-ebd8-4367-aeb2-91d6d9120d9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.213310] env[65319]: INFO networking_nsxv3.common.synchronization [req-b2601f6e-e7e5-47bd-8459-e19d1fc53182 req-7d93effd-d0e7-4a55-8e6f-3c43c7254fa4 tempest-ServerExternalEventsTest-1872843560 tempest-ServerExternalEventsTest-1872843560-project-member] Enqueued Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 668.214146] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 668.214352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.214929] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGHEST for action security_group_members [ 668.215402] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.215560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.215631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.215831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.216144] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.216144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.216144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.216316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.216540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.216540] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.661683] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.718931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.719122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.719173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.719391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.719484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.719687] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.720149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.720149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.720149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.720149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.720149] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 is going to be updated. [ 668.750289] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.750504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.750571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.750807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.750976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.760607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: IN_PROGRESS for 2s [ 669.164622] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.164866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.164961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.165231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.167022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.167022] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be created. [ 669.194867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.195103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.195214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.195533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.195813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.207726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: UNINITIALIZED for 2s [ 669.390990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3fa756c-984c-4373-aa5f-0c3702edf82e in Status: SUCCESS [ 669.390990] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e deletion is rescheduled due to dependency. [ 669.390990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.498019] env[65319]: INFO networking_nsxv3.common.synchronization [req-51aa2c2f-093a-40a4-94ef-75dca8c754a8 req-495a79e2-ade1-4dd3-9b42-76a5d4a8ad00 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 670.498019] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 670.498726] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.499020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.501079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.501079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.501079] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.660385] env[65319]: INFO networking_nsxv3.common.synchronization [None req-9d832996-0bfe-4ead-a6d1-ebd09bc64f8e None None] Enqueued Resource ID: 7a37a2d6-34e3-46f3-b160-18fefeb91ed6 with Priority: HIGHEST for action port [ 670.660654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a37a2d6-34e3-46f3-b160-18fefeb91ed6 with Priority: HIGHEST for action port [ 670.661283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a37a2d6-34e3-46f3-b160-18fefeb91ed6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.661426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a37a2d6-34e3-46f3-b160-18fefeb91ed6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.661492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a37a2d6-34e3-46f3-b160-18fefeb91ed6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.661763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a37a2d6-34e3-46f3-b160-18fefeb91ed6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.661844] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a37a2d6-34e3-46f3-b160-18fefeb91ed6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.772529] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 in Status: SUCCESS [ 670.772635] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 deletion is rescheduled due to dependency. [ 670.773297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.005983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.005983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.005983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 already deleted. [ 671.005983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.076090] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.076090] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.076391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.076511] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.076795] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.076953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.077078] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.077395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.077996] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.078274] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.078450] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.078589] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.078698] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.078824] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.078928] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.079066] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.101225] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.101390] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.101519] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.101905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.102300] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-da98413e-66b2-4a5f-8c79-700562060310 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.102486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.102602] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.102972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.103141] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da98413e-66b2-4a5f-8c79-700562060310',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.164252] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a37a2d6-34e3-46f3-b160-18fefeb91ed6 [ 671.164487] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.164623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.164720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.164943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.165060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.165157] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a37a2d6-34e3-46f3-b160-18fefeb91ed6 already deleted. [ 671.165270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a37a2d6-34e3-46f3-b160-18fefeb91ed6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.219278] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 671.219491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.219659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.219876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.220077] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.220196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.220262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.220416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.220499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.220610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.220669] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.606907] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.607252] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.607300] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.607548] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.607689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.607837] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port da98413e-66b2-4a5f-8c79-700562060310 not found, creating... [ 671.608112] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.608267] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608378] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.608605] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.609016] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.609326] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.609480] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.609591] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.609806] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.610124] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.610268] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: da98413e-66b2-4a5f-8c79-700562060310 is going to be created. [ 671.633312] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.633312] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.633455] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.633605] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.633948] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.634228] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.723227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.723414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.723489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.723839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.724732] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.724732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.725030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.725030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.725112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.725222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.725324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.725490] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.725637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.725637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.725790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.726110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.726110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.726277] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.228993] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31328668-cad5-4bcc-9c72-54d3bf9877fe: rpc.has_security_group_logging(os_id): False [ 672.260943] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.261183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.261549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.261785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.262269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.262633] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.262776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.262897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.263182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.263510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.264197] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.264197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.264197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.264538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.264538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.264781] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.265020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.265149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.265428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.265600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.265768] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be created. [ 672.333148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.333330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.333402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.333617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.333834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.365860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 672.386725] env[65319]: INFO networking_nsxv3.common.synchronization [req-51aa2c2f-093a-40a4-94ef-75dca8c754a8 req-aaa74dbb-7729-470f-a9a5-4ab1294361dc service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 672.386920] env[65319]: INFO networking_nsxv3.common.synchronization [req-51aa2c2f-093a-40a4-94ef-75dca8c754a8 req-aaa74dbb-7729-470f-a9a5-4ab1294361dc service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 672.387072] env[65319]: INFO networking_nsxv3.common.synchronization [req-51aa2c2f-093a-40a4-94ef-75dca8c754a8 req-aaa74dbb-7729-470f-a9a5-4ab1294361dc service nova] Enqueued Resource ID: da98413e-66b2-4a5f-8c79-700562060310 with Priority: HIGHEST for action port [ 672.387441] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 672.387584] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 672.387682] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da98413e-66b2-4a5f-8c79-700562060310 with Priority: HIGHEST for action port [ 672.388666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.389310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.389310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.389310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.389310] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.390563] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.390563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.390563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.390563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.391336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.391336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.391336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.391336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.391336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.391610] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.393955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-da98413e-66b2-4a5f-8c79-700562060310 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.393955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.393955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.393955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.393955] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da98413e-66b2-4a5f-8c79-700562060310',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.895273] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.896510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.896510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.896688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da98413e-66b2-4a5f-8c79-700562060310 with status ACTIVE [ 672.896780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.897026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.897026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.898815] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.898815] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.898815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.898815] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da98413e-66b2-4a5f-8c79-700562060310 is going to be updated. [ 672.923758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.923976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.925038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.925038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.925038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.925038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da98413e-66b2-4a5f-8c79-700562060310" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.402094] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.552112] env[65319]: INFO networking_nsxv3.common.synchronization [None req-0384a259-ff1b-4a76-a875-30e32f71ad2f None None] Enqueued Resource ID: 708a45b9-a5cb-4ee6-a537-347c7e77875a with Priority: HIGHEST for action port [ 673.552112] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 708a45b9-a5cb-4ee6-a537-347c7e77875a with Priority: HIGHEST for action port [ 673.552801] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-708a45b9-a5cb-4ee6-a537-347c7e77875a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.552801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-708a45b9-a5cb-4ee6-a537-347c7e77875a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.552801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-708a45b9-a5cb-4ee6-a537-347c7e77875a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.552988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-708a45b9-a5cb-4ee6-a537-347c7e77875a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.552988] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('708a45b9-a5cb-4ee6-a537-347c7e77875a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.875861] env[65319]: INFO networking_nsxv3.common.synchronization [None req-834e1854-6fe7-42bb-a6b0-3db891c16aa5 tempest-ServerActionsV293TestJSON-1314727380 tempest-ServerActionsV293TestJSON-1314727380-project-member] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 673.876753] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 673.878073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.878073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.878073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.878370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.878453] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.905143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.905439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.905439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.905719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.905719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.905719] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be created. [ 673.936839] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.936839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.936839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.936839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.937383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.950802] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: UNINITIALIZED for 2s [ 674.056478] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 708a45b9-a5cb-4ee6-a537-347c7e77875a [ 674.056877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.057197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.057197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.057869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.057869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.057869] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:708a45b9-a5cb-4ee6-a537-347c7e77875a already deleted. [ 674.057869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-708a45b9-a5cb-4ee6-a537-347c7e77875a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.166651] env[65319]: INFO networking_nsxv3.common.synchronization [None req-161307da-63b4-43a7-b747-624dc50605a3 tempest-ServerActionsV293TestJSON-1314727380 tempest-ServerActionsV293TestJSON-1314727380-project-member] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 674.168479] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 674.168857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.168920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.381153] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 674.381351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.407722] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.407879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.407939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.408135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.408223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.410491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30580859-8cff-47d8-a383-cb85009ec257 already deleted. [ 674.410491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.410491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.410491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.410491] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.939516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.939516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.939516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.939516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.939516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.939516] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30580859-8cff-47d8-a383-cb85009ec257 already deleted. [ 674.939516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.964918] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 675.965301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.965301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.965909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.965909] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.966113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.966113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.967093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.967093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.967093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.967093] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.362639] env[65319]: INFO networking_nsxv3.common.synchronization [req-e866e9cb-33f7-42d0-bf60-9468976bdc2d req-5003e5c6-1d71-42ee-a519-5d859764bc15 tempest-FloatingIPsAssociationNegativeTestJSON-789258298 tempest-FloatingIPsAssociationNegativeTestJSON-789258298-project-member] Enqueued Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 676.362639] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGHEST for action security_group_members [ 676.362639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.362639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.362639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.362639] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.469538] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.469811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.469905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.470191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.470815] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.472106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.472254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.472502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.472758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.472909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.473158] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.473319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.474231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.474451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.474902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.475097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.475175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.475377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.475495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.476044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.476044] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.869575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.869575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.869575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.869888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.869888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.870113] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.870200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.870200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.870359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.870489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.870527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e is going to be updated. [ 676.906858] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.907155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.907155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.907388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.907543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.919995] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: IN_PROGRESS for 2s [ 676.981333] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 677.010155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.010155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.010155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.010405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.010549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.010761] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.010867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.010867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.011040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.011113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.011302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.011413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.011730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.011730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.015413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.015413] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.016662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.016879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.017049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.017117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.017161] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be created. [ 677.093495] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.093495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.093495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.093495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.093495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.118808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 678.932968] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e in Status: SUCCESS [ 678.933368] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e deletion is rescheduled due to dependency. [ 678.933368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.132928] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 679.133268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.207895] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0c4b625-ee6a-4a48-a0f7-95c4c892b1a6 req-762a423b-809e-4ffc-bfe5-30d3fe1ef04f tempest-InstanceActionsNegativeTestJSON-1381764177 tempest-InstanceActionsNegativeTestJSON-1381764177-project-member] Enqueued Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 680.208831] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 680.209246] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.209385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.209502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.209788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.209962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.210109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.210227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.210482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.212917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.212917] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.469558] env[65319]: INFO networking_nsxv3.common.synchronization [None req-59c58f69-53c0-4007-b356-579104fc96d5 None None] Enqueued Resource ID: bbc2d381-9296-4302-b66d-ebaaff63df57 with Priority: HIGHEST for action port [ 680.469558] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbc2d381-9296-4302-b66d-ebaaff63df57 with Priority: HIGHEST for action port [ 680.470715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbc2d381-9296-4302-b66d-ebaaff63df57 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.470715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbc2d381-9296-4302-b66d-ebaaff63df57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.471565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbc2d381-9296-4302-b66d-ebaaff63df57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.471565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbc2d381-9296-4302-b66d-ebaaff63df57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.471565] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc2d381-9296-4302-b66d-ebaaff63df57',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.576668] env[65319]: INFO networking_nsxv3.common.synchronization [req-06de14cf-20f6-4568-9b4f-e34f7badec22 req-b6cd4c90-e19f-429e-a475-8adb4ab8d073 tempest-DeleteServersAdminTestJSON-985890744 tempest-DeleteServersAdminTestJSON-985890744-project-member] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 680.576816] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGHEST for action security_group_members [ 680.577718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.577718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.577718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.577718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.577718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.578034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.579254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.579254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.579254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.579254] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.713714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.713943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.714039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.714281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.714405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.714636] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.714743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.714808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.714996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.715099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.715187] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea already deleted. [ 680.715271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.747201] env[65319]: INFO networking_nsxv3.common.synchronization [None req-9ab3fb4a-3ca2-4beb-9ace-b4d4e808f565 None None] Enqueued Resource ID: 82220010-caf1-49a1-95ce-a8885b341e7a with Priority: HIGHEST for action port [ 680.747309] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82220010-caf1-49a1-95ce-a8885b341e7a with Priority: HIGHEST for action port [ 680.747773] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-82220010-caf1-49a1-95ce-a8885b341e7a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.747901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82220010-caf1-49a1-95ce-a8885b341e7a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.747968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82220010-caf1-49a1-95ce-a8885b341e7a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.748238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82220010-caf1-49a1-95ce-a8885b341e7a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.748321] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82220010-caf1-49a1-95ce-a8885b341e7a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.974940] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbc2d381-9296-4302-b66d-ebaaff63df57 [ 680.975324] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.975324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.975450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.978022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.978022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.978022] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbc2d381-9296-4302-b66d-ebaaff63df57 already deleted. [ 680.978022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbc2d381-9296-4302-b66d-ebaaff63df57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.082510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.082703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.082772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.083207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.083207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.083413] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.083504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.083580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.083808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.083915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.084048] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be updated. [ 681.120573] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.120573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.120764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.121235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.121235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.132322] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: IN_PROGRESS for 2s [ 681.250960] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82220010-caf1-49a1-95ce-a8885b341e7a [ 681.251550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.251550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.251550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.251872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.251872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.253412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82220010-caf1-49a1-95ce-a8885b341e7a already deleted. [ 681.253412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82220010-caf1-49a1-95ce-a8885b341e7a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.435370] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.435595] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-919" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.436058] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-919" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.436200] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-919" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.437364] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.437364] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.437364] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.437364] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.437364] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.437364] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.437986] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.437986] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.437986] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.437986] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.437986] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.438254] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.465020] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.465020] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.465020] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.465020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-919" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.465020] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-55a22f18-675e-4651-9ba8-9cb11b6e9244 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.465020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.465020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.465020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.465020] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a22f18-675e-4651-9ba8-9cb11b6e9244',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.967275] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.967275] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.967492] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.967630] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.967791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.967954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 55a22f18-675e-4651-9ba8-9cb11b6e9244 not found, creating... [ 681.968268] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.968464] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.968538] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.968817] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.968959] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.969334] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.969629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.970593] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.970593] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.971300] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.971300] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 55a22f18-675e-4651-9ba8-9cb11b6e9244 is going to be created. [ 681.993940] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.993940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.993940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.994190] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.994293] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.994516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.112252] env[65319]: INFO networking_nsxv3.common.synchronization [req-72ff9664-bbe5-43d9-9adf-ee015206217b req-72a55dcb-2736-4976-87b2-2becb8aba805 tempest-ServerAddressesNegativeTestJSON-1352329742 tempest-ServerAddressesNegativeTestJSON-1352329742-project-member] Enqueued Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 682.112824] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGHEST for action security_group_members [ 682.113364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.113512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.113556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.113794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.113946] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.114269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.114269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.114269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.114409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.114443] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.620390] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.620390] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.620390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.620390] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 is going to be updated. [ 682.658065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.658249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.658313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.658521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.658666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673670] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: IN_PROGRESS for 2s [ 682.697786] env[65319]: INFO networking_nsxv3.common.synchronization [req-72265b53-208e-4931-bd16-aa0cb8d8bfeb req-9308269c-e0bf-4bb8-8aa5-734da0dc5dcf tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 682.697786] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 682.699312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.699471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.699515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.699722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.699896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.699990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.700061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.700219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.700309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.700405] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0c4b625-ee6a-4a48-a0f7-95c4c892b1a6 req-7a39b3ad-315b-4b61-847f-898d906f5d3c service nova] Enqueued Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_rules [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0c4b625-ee6a-4a48-a0f7-95c4c892b1a6 req-7a39b3ad-315b-4b61-847f-898d906f5d3c service nova] Enqueued Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0c4b625-ee6a-4a48-a0f7-95c4c892b1a6 req-7a39b3ad-315b-4b61-847f-898d906f5d3c service nova] Enqueued Resource ID: 55a22f18-675e-4651-9ba8-9cb11b6e9244 with Priority: HIGHEST for action port [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_rules [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 682.811153] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a22f18-675e-4651-9ba8-9cb11b6e9244 with Priority: HIGHEST for action port [ 682.811153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.811153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.812539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.812917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.813032] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.814552] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.814759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.815491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.815491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.815491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.815663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.815663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.815731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.816497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.816497] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.817095] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-55a22f18-675e-4651-9ba8-9cb11b6e9244 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.817365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.817365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.817467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.817525] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a22f18-675e-4651-9ba8-9cb11b6e9244',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.090923] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d45ae162-8ae0-40f9-a685-d399dd7df85c None None] Enqueued Resource ID: 5124aa4d-4ea0-4f17-a681-325e4d19d7f2 with Priority: HIGHEST for action port [ 683.091820] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5124aa4d-4ea0-4f17-a681-325e4d19d7f2 with Priority: HIGHEST for action port [ 683.092888] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5124aa4d-4ea0-4f17-a681-325e4d19d7f2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.093013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5124aa4d-4ea0-4f17-a681-325e4d19d7f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.093089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5124aa4d-4ea0-4f17-a681-325e4d19d7f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.093376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5124aa4d-4ea0-4f17-a681-325e4d19d7f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.093459] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5124aa4d-4ea0-4f17-a681-325e4d19d7f2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.144028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e in Status: SUCCESS [ 683.144263] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e deletion is rescheduled due to dependency. [ 683.144389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.205518] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.297951] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.298148] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.299380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.299380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.299380] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.299380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.299635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.299747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.299897] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.300107] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.300262] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.300427] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.300546] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.300653] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.300755] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.300885] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.319478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.319478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.323720] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.323946] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.324440] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.324440] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.324575] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.327557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.327557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.327557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.327557] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3693261-6d1e-4b30-97f4-98ef7e48b8dd',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.327844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55a22f18-675e-4651-9ba8-9cb11b6e9244 with status ACTIVE [ 683.329252] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.329252] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.329252] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.329252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.330055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.330055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.330055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.330055] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55a22f18-675e-4651-9ba8-9cb11b6e9244 is going to be updated. [ 683.331998] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.344320] env[65319]: INFO networking_nsxv3.common.synchronization [None req-92337b97-eae6-408f-ae98-4e78fd2ad878 None None] Enqueued Resource ID: 9175a7a5-04e5-4177-b3f6-33618e9d7f0f with Priority: HIGHEST for action port [ 683.344320] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9175a7a5-04e5-4177-b3f6-33618e9d7f0f with Priority: HIGHEST for action port [ 683.344320] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-9175a7a5-04e5-4177-b3f6-33618e9d7f0f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.344320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9175a7a5-04e5-4177-b3f6-33618e9d7f0f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.344320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9175a7a5-04e5-4177-b3f6-33618e9d7f0f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.344320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9175a7a5-04e5-4177-b3f6-33618e9d7f0f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.344320] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9175a7a5-04e5-4177-b3f6-33618e9d7f0f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.357156] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.357494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.357494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.357626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.357761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.357926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55a22f18-675e-4651-9ba8-9cb11b6e9244" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.597346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5124aa4d-4ea0-4f17-a681-325e4d19d7f2 [ 683.597584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.597721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.598274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.598274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.598274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.598274] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5124aa4d-4ea0-4f17-a681-325e4d19d7f2 already deleted. [ 683.598450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5124aa4d-4ea0-4f17-a681-325e4d19d7f2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.714434] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.835598] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.835598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.835598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.835598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.835598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.835598] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port e3693261-6d1e-4b30-97f4-98ef7e48b8dd not found, creating... [ 683.836788] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.836788] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.836788] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.837031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.839235] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.839885] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.840099] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.840353] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.840454] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.840698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.840759] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: e3693261-6d1e-4b30-97f4-98ef7e48b8dd is going to be created. [ 683.841994] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.850045] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9175a7a5-04e5-4177-b3f6-33618e9d7f0f [ 683.850364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.850520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.850520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.851098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.851098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.851098] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9175a7a5-04e5-4177-b3f6-33618e9d7f0f already deleted. [ 683.851098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9175a7a5-04e5-4177-b3f6-33618e9d7f0f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.866772] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.867123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.867189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.867457] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.867908] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.869505] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.217162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.218313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.218313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.218313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.218313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.218313] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 684.253168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.253327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.253434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.253932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.265554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 684.345532] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.345658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.345703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.345904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.346009] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.346126] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea is going to be created. [ 684.382568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.382798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.383019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.383179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.393023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: UNINITIALIZED for 2s [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [req-72265b53-208e-4931-bd16-aa0cb8d8bfeb req-1c816bbd-b385-456c-98ac-5d7004cedeb3 service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [req-72265b53-208e-4931-bd16-aa0cb8d8bfeb req-1c816bbd-b385-456c-98ac-5d7004cedeb3 service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [req-72265b53-208e-4931-bd16-aa0cb8d8bfeb req-1c816bbd-b385-456c-98ac-5d7004cedeb3 service nova] Enqueued Resource ID: e3693261-6d1e-4b30-97f4-98ef7e48b8dd with Priority: HIGHEST for action port [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 684.602874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3693261-6d1e-4b30-97f4-98ef7e48b8dd with Priority: HIGHEST for action port [ 684.603275] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.603353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.603417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.603674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.603713] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.604675] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.604793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.605043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.605145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.605209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.605393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.605513] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3693261-6d1e-4b30-97f4-98ef7e48b8dd',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.683188] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 in Status: SUCCESS [ 684.683455] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 deletion is rescheduled due to dependency. [ 684.683498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.107477] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.107902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.107902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3693261-6d1e-4b30-97f4-98ef7e48b8dd with status ACTIVE [ 685.107902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.108146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.108146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.108304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.108393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.108594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.108694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.108749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.108938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.109035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.109218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.109315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.109372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.109511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.109586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.109669] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3693261-6d1e-4b30-97f4-98ef7e48b8dd is going to be updated. [ 685.130989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.131564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.131564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.131564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.131564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.131800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3693261-6d1e-4b30-97f4-98ef7e48b8dd" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.550164] env[65319]: INFO networking_nsxv3.common.synchronization [req-dca89558-beb3-4e09-ba61-64c22c378991 req-086e8d15-0b5e-4762-87cc-67f28229036e tempest-ServersTestManualDisk-63027693 tempest-ServersTestManualDisk-63027693-project-member] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 685.550694] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 685.551008] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.551142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.551211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.551467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.551630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.551788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.551862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.552362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.552611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.553997] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.059207] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.059408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.059679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.059790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.060043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.060151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.060191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.060381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.060470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.060593] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 already deleted. [ 686.060674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.278526] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 686.278526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.278929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.278929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.279101] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.279460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.279587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.279720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.279804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.279901] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.405596] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: SUCCESS [ 686.406485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.406485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.406775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.407229] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.407229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.407229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.407462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.407462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.407462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.407792] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.717512] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.718296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-912" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.718522] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-912" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.718911] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-912" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.719281] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.719482] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.719622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.719901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.720118] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.720404] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.720545] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.720684] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.720840] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.721010] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.721627] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.721881] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.748035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.748035] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.748035] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.748313] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-912" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.748663] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.749175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.749438] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.749766] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.749984] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30d58f7-03d5-4d6f-9a0d-ebb60d190777',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.788016] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.889456] env[65319]: INFO networking_nsxv3.common.synchronization [None req-193e35f1-1e34-4874-ad80-8456b4aa0de6 None None] Enqueued Resource ID: aadfedbb-d321-424b-981e-9a6cf76ac82d with Priority: HIGHEST for action port [ 686.890035] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aadfedbb-d321-424b-981e-9a6cf76ac82d with Priority: HIGHEST for action port [ 686.890359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-aadfedbb-d321-424b-981e-9a6cf76ac82d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.890483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aadfedbb-d321-424b-981e-9a6cf76ac82d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.890551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aadfedbb-d321-424b-981e-9a6cf76ac82d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.890820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aadfedbb-d321-424b-981e-9a6cf76ac82d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.890929] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadfedbb-d321-424b-981e-9a6cf76ac82d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.911129] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.911223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.911286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.911518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.911721] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.911871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.911962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.912162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.912345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.912593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.912664] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.912744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.912838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.913132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.913363] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.913503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.913586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.913825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.913935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.914058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.914159] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.253345] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.253674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.253893] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.254337] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.254592] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.254858] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port b30d58f7-03d5-4d6f-9a0d-ebb60d190777 not found, creating... [ 687.255350] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.255637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.255858] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.256540] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.256805] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.257338] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.257582] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.257768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.258311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.258551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.258753] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: b30d58f7-03d5-4d6f-9a0d-ebb60d190777 is going to be created. [ 687.282294] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.282623] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.282623] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.282991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.283245] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.283476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.291073] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.394928] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aadfedbb-d321-424b-981e-9a6cf76ac82d [ 687.394928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.394928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.394928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.397546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.397546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.397546] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aadfedbb-d321-424b-981e-9a6cf76ac82d already deleted. [ 687.397546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aadfedbb-d321-424b-981e-9a6cf76ac82d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.417138] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea: rpc.has_security_group_logging(os_id): False [ 687.442487] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.442701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.443884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.443884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.443884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.443884] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.443884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.443884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.444185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.444301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.444595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.444724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.444836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.444936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.445046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.446928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.447089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.447139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.447845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.447939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.448072] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea is going to be created. [ 687.523193] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.523193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.523358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.523495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.523746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.541446] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: IN_PROGRESS for 2s [ 687.794226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.794507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.794623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.794912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.795065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.795202] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 687.932079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.934079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.934079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.934079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.934079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.950492] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 688.230645] env[65319]: INFO networking_nsxv3.common.synchronization [req-dca89558-beb3-4e09-ba61-64c22c378991 req-8b81d587-696d-46c0-9c32-8d9259b3c279 service nova] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 688.230930] env[65319]: INFO networking_nsxv3.common.synchronization [req-dca89558-beb3-4e09-ba61-64c22c378991 req-8b81d587-696d-46c0-9c32-8d9259b3c279 service nova] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 688.235373] env[65319]: INFO networking_nsxv3.common.synchronization [req-dca89558-beb3-4e09-ba61-64c22c378991 req-8b81d587-696d-46c0-9c32-8d9259b3c279 service nova] Enqueued Resource ID: b30d58f7-03d5-4d6f-9a0d-ebb60d190777 with Priority: HIGHEST for action port [ 688.236469] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_rules [ 688.236469] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 688.236469] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b30d58f7-03d5-4d6f-9a0d-ebb60d190777 with Priority: HIGHEST for action port [ 688.237714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.237714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.237714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.237714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.237714] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.239197] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.239963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.240620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.241169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.241169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.241875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.242068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.242442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.242442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.243268] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.244831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.244831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.244831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.244831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.246103] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30d58f7-03d5-4d6f-9a0d-ebb60d190777',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.750477] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.752520] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.752736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.753222] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b30d58f7-03d5-4d6f-9a0d-ebb60d190777 with status ACTIVE [ 688.753441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.753554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.753625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.753960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.757084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.757084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.757084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.757084] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b30d58f7-03d5-4d6f-9a0d-ebb60d190777 is going to be updated. [ 688.780180] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.780415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.780525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.780851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.781085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.781342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b30d58f7-03d5-4d6f-9a0d-ebb60d190777" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.254441] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.557273] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: SUCCESS [ 689.557542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.759506] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.759796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.759894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.760180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.760632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.760632] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 is going to be created. [ 689.792085] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.792240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.792314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.792546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.792700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.807443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: UNINITIALIZED for 2s [ 689.959987] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 689.960232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.960407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.960724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.960853] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.960976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.961053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.961228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.961310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.961407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.961548] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.464196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.464739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.464963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.465326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.465614] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.465789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.465896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.466286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.466457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.466599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.466824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.467028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.467161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.467452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.467995] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.467995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.467995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.468220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.468303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.468540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.468603] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.538392] env[65319]: INFO networking_nsxv3.common.synchronization [req-59def195-b6d0-42fe-83c8-83ac1e6e9f6e req-53f15765-4688-45b5-8321-05290a628355 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 690.538885] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 690.539198] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.539316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.539398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.539621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.539804] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.539906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.539968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.540295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.540399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.540512] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.664383] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e42447b3-5145-4225-8cf5-cdf1361a5c87 None None] Enqueued Resource ID: fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6 with Priority: HIGHEST for action port [ 690.664735] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6 with Priority: HIGHEST for action port [ 690.665228] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.665312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.665312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.665577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.665674] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.971242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31328668-cad5-4bcc-9c72-54d3bf9877fe: rpc.has_security_group_logging(os_id): False [ 690.991013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.991219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.991312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.991822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.992120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.992374] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.992549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.992646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.992856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.992945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.993180] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.993281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.993353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.993577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.993702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.993960] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.994096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.994152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.994302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.994445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.994566] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 691.045155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.045155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.045155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.045358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.045443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.045653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.045779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.045859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.045987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.046081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.046173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 691.069576] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.069841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.069889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.070230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.070435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.083501] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.083706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.083781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.084068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.084308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.087278] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 691.096016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 691.169416] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6 [ 691.169657] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.169793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.169873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.170115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.170210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.170306] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6 already deleted. [ 691.170388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe2f1a2d-1d8a-4aa8-b9a6-8fb9074197c6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.824386] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: SUCCESS [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.824386] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.824386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.824386] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.327222] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.830049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 212b5fb1-e89d-45a0-bc24-507876349ec6: rpc.has_security_group_logging(os_id): False [ 692.851043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.852038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.852038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.852038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.852038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.852038] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.852038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.852289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.852289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.852340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.852422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 is going to be created. [ 692.930058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.930058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.930058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.930058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.930058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.940209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: IN_PROGRESS for 2s [ 693.113733] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 693.113733] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 693.113733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.118253] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 693.118253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.500092] env[65319]: INFO networking_nsxv3.common.synchronization [req-9e3f3761-fa2b-4e6e-a108-67320e406a07 req-1a5263f0-813f-4b04-b3b4-a188756085ad tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 693.500092] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 693.500092] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.500092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.500092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.500092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.500092] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.500611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.500611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.500673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.500823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.500976] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.004384] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.004613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.004753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.005069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.005217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.005486] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.005623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.005712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.005951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.006094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.006213] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 694.037789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.037976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.038043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.038274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.038417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.063837] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 694.218486] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.218698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.218846] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.219310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.219621] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.219782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.219892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.220129] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.220271] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.220475] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.220581] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.220681] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.220783] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.220932] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.221116] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.221315] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.243521] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.243771] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.243987] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.244223] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.244658] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.244920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.245019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.245375] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.245573] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6fab1f-6d99-4998-a074-599e3ff4ed2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.747641] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.747972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.747972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.748323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.748454] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.748609] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 5f6fab1f-6d99-4998-a074-599e3ff4ed2c not found, creating... [ 694.748880] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.749087] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.749201] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.749445] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.749573] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.749867] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.750103] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.750239] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.750462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.750593] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.750745] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5f6fab1f-6d99-4998-a074-599e3ff4ed2c is going to be created. [ 694.774094] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.774351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.774448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.774721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.774975] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.775215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.956551] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: SUCCESS [ 694.956551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.494386] env[65319]: INFO networking_nsxv3.common.synchronization [req-9e3f3761-fa2b-4e6e-a108-67320e406a07 req-0e18e3c7-5cda-4a52-95f9-84f10d5f2983 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 695.494569] env[65319]: INFO networking_nsxv3.common.synchronization [req-9e3f3761-fa2b-4e6e-a108-67320e406a07 req-0e18e3c7-5cda-4a52-95f9-84f10d5f2983 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 695.494735] env[65319]: INFO networking_nsxv3.common.synchronization [req-9e3f3761-fa2b-4e6e-a108-67320e406a07 req-0e18e3c7-5cda-4a52-95f9-84f10d5f2983 service nova] Enqueued Resource ID: 5f6fab1f-6d99-4998-a074-599e3ff4ed2c with Priority: HIGHEST for action port [ 695.495447] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 695.495618] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 695.495741] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6fab1f-6d99-4998-a074-599e3ff4ed2c with Priority: HIGHEST for action port [ 695.496578] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.496756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.496894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.497186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.497525] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.498828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.498956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499208] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.499345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.499639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.499817] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6fab1f-6d99-4998-a074-599e3ff4ed2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.005373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.005373] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f6fab1f-6d99-4998-a074-599e3ff4ed2c with status ACTIVE [ 696.005373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.005373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.005373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.005373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.006379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.006379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.006379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.006379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.006379] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f6fab1f-6d99-4998-a074-599e3ff4ed2c is going to be updated. [ 696.030679] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.031430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.031430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.031430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.031588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.032330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f6fab1f-6d99-4998-a074-599e3ff4ed2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.076268] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 696.076804] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 696.078231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.078231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.078231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.078741] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.078967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.079053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.079279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.079407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.079564] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.582587] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.086269] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.354608] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8c254720-4bfd-44f9-850e-e05f57fabbb7 None None] Enqueued Resource ID: 99ac96f9-77f7-40e5-a05f-1623612e460b with Priority: HIGHEST for action port [ 697.355243] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ac96f9-77f7-40e5-a05f-1623612e460b with Priority: HIGHEST for action port [ 697.355557] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ac96f9-77f7-40e5-a05f-1623612e460b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.355680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ac96f9-77f7-40e5-a05f-1623612e460b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.355735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ac96f9-77f7-40e5-a05f-1623612e460b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.356019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ac96f9-77f7-40e5-a05f-1623612e460b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.356245] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ac96f9-77f7-40e5-a05f-1623612e460b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.589900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.590021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.590065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.590251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.590347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.590447] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 697.621231] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.621385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.621457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.621738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.621870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.633898] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 697.858274] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99ac96f9-77f7-40e5-a05f-1623612e460b [ 697.858441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.858576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.858709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.858856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.858948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.859047] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99ac96f9-77f7-40e5-a05f-1623612e460b already deleted. [ 697.859127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ac96f9-77f7-40e5-a05f-1623612e460b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.644523] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 699.645234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.646051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.646051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.646282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.646410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.646498] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.151044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.151211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.151296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.151495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.151662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.151765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.151848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.152565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.152565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.152565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.152565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.152565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.152849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.152849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.152912] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.152980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.153377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.153377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.153377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.153377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.153542] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.259401] env[65319]: INFO networking_nsxv3.common.synchronization [None req-86447816-3535-4571-99ef-f102ae96b86c tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 700.259895] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 700.260364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.260364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.260364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.260557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.260640] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.385370] env[65319]: INFO networking_nsxv3.common.synchronization [None req-396f5177-e521-4e29-a8b2-75294d7b736e tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 700.385370] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 700.385370] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.385370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.659346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d51d74c1-0bc9-4f08-9e69-0f36720ce33b: rpc.has_security_group_logging(os_id): False [ 700.680488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.680560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.680597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.680802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.680898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.681187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.681266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.681301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.681430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.681508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.681867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.681867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.681867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.682628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.682628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.682628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.682628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.682628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.682828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.682828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.682886] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 700.752238] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.752238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.752238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.752238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.752238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.764854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 700.797923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.800018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 already deleted. [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.800018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.800018] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.325044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.326101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.326101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.326101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.326101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.326101] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 already deleted. [ 701.326101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.602235] env[65319]: INFO networking_nsxv3.common.synchronization [None req-cc1781ad-84be-40d4-9e4d-b737d63500cd None None] Enqueued Resource ID: bcd0350e-367c-4ec3-9f4a-de03131ba7f4 with Priority: HIGHEST for action port [ 702.604535] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd0350e-367c-4ec3-9f4a-de03131ba7f4 with Priority: HIGHEST for action port [ 702.604944] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd0350e-367c-4ec3-9f4a-de03131ba7f4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.605514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd0350e-367c-4ec3-9f4a-de03131ba7f4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.605588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd0350e-367c-4ec3-9f4a-de03131ba7f4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.605870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd0350e-367c-4ec3-9f4a-de03131ba7f4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.605959] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd0350e-367c-4ec3-9f4a-de03131ba7f4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.785776] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 702.787160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.110276] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcd0350e-367c-4ec3-9f4a-de03131ba7f4 [ 703.110622] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.110802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.110851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.111113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.111222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.111338] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcd0350e-367c-4ec3-9f4a-de03131ba7f4 already deleted. [ 703.111445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd0350e-367c-4ec3-9f4a-de03131ba7f4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.127036] env[65319]: INFO networking_nsxv3.common.synchronization [None req-ffb83a90-aadb-453d-bce2-f53ccc96daaa None None] Enqueued Resource ID: 480d92bb-e48d-4aed-9b59-91355777012a with Priority: HIGHEST for action port [ 703.127036] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480d92bb-e48d-4aed-9b59-91355777012a with Priority: HIGHEST for action port [ 703.127036] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-480d92bb-e48d-4aed-9b59-91355777012a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.127036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-480d92bb-e48d-4aed-9b59-91355777012a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.127036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-480d92bb-e48d-4aed-9b59-91355777012a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.127661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-480d92bb-e48d-4aed-9b59-91355777012a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.127783] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('480d92bb-e48d-4aed-9b59-91355777012a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.634484] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 480d92bb-e48d-4aed-9b59-91355777012a [ 703.634775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.634938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.635028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.636441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.636441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.636441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:480d92bb-e48d-4aed-9b59-91355777012a already deleted. [ 703.636441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-480d92bb-e48d-4aed-9b59-91355777012a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.858814] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-9778b9f8-2679-42f0-9ce7-99f961fb32f9 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 703.862090] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 703.862439] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.862616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.862616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.862824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.862991] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.864047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.864047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.864047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.864047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.864047] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.336179] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.336413] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.336597] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.336940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.337362] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.337551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.337691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.338410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.338626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.338949] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.339060] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.339205] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.339384] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.339558] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.339750] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.339923] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.360619] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.361562] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.361562] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.361562] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.361752] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-889d1137-d647-41c4-8e03-b45094f02d6d taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.361885] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.362063] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.362466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.362649] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('889d1137-d647-41c4-8e03-b45094f02d6d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.367345] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.367345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.367345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.367617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.367617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.367807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.368441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.368441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.368441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.368441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.368441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 704.396878] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.398183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.398183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.398342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.398470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.407981] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 704.865396] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.865784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.865784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.866085] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.866230] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.866427] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 889d1137-d647-41c4-8e03-b45094f02d6d not found, creating... [ 704.867033] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.867033] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.867033] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.867278] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.867414] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.867778] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.867985] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.868563] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.868844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.869010] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.869181] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 889d1137-d647-41c4-8e03-b45094f02d6d is going to be created. [ 704.892416] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.892633] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.892750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.893060] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.893296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.893524] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.947722] env[65319]: INFO networking_nsxv3.common.synchronization [None req-31fd7f18-5199-4bac-bb8e-37742fecf9e7 None None] Enqueued Resource ID: 9306197a-105c-46c8-80ec-bb2d1522f603 with Priority: HIGHEST for action port [ 704.948269] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9306197a-105c-46c8-80ec-bb2d1522f603 with Priority: HIGHEST for action port [ 704.949094] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-9306197a-105c-46c8-80ec-bb2d1522f603 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.949094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9306197a-105c-46c8-80ec-bb2d1522f603" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.949094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9306197a-105c-46c8-80ec-bb2d1522f603" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.949503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9306197a-105c-46c8-80ec-bb2d1522f603" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.949630] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9306197a-105c-46c8-80ec-bb2d1522f603',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.454254] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9306197a-105c-46c8-80ec-bb2d1522f603 [ 705.455400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.455400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.455400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.455400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.455400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.455400] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9306197a-105c-46c8-80ec-bb2d1522f603 already deleted. [ 705.455400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9306197a-105c-46c8-80ec-bb2d1522f603" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.633595] env[65319]: INFO networking_nsxv3.common.synchronization [None req-87c6a60f-24de-4240-a348-7df1502d46e2 None None] Enqueued Resource ID: c88df468-9f9d-44f1-8fb6-6452965dd0aa with Priority: HIGHEST for action port [ 705.634252] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88df468-9f9d-44f1-8fb6-6452965dd0aa with Priority: HIGHEST for action port [ 705.634568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c88df468-9f9d-44f1-8fb6-6452965dd0aa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.634695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c88df468-9f9d-44f1-8fb6-6452965dd0aa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.634763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c88df468-9f9d-44f1-8fb6-6452965dd0aa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.635376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c88df468-9f9d-44f1-8fb6-6452965dd0aa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.635510] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c88df468-9f9d-44f1-8fb6-6452965dd0aa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.682434] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-e102a307-72ec-481f-b3e3-7049d290aa50 service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 705.682905] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-e102a307-72ec-481f-b3e3-7049d290aa50 service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 705.682905] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-e102a307-72ec-481f-b3e3-7049d290aa50 service nova] Enqueued Resource ID: 889d1137-d647-41c4-8e03-b45094f02d6d with Priority: HIGHEST for action port [ 705.682978] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 705.683098] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 705.683200] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 889d1137-d647-41c4-8e03-b45094f02d6d with Priority: HIGHEST for action port [ 705.683757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.684025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.684193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.684615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.684722] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.686268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.686426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.687149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-889d1137-d647-41c4-8e03-b45094f02d6d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.687149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.687149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.687149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.687149] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('889d1137-d647-41c4-8e03-b45094f02d6d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.116083] env[65319]: INFO networking_nsxv3.common.synchronization [req-9cda2c40-2acc-4d01-9ac3-8df7cd640b78 req-efdc0517-1187-445c-969d-4ecdc78dde7b tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 706.117744] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 706.118839] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.118999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.119252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.119478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.119803] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.119917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.119986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.120166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.120391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.120489] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.140296] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c88df468-9f9d-44f1-8fb6-6452965dd0aa [ 706.140532] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.140671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.140738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.141069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.141191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.141246] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c88df468-9f9d-44f1-8fb6-6452965dd0aa already deleted. [ 706.141338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c88df468-9f9d-44f1-8fb6-6452965dd0aa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.190905] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 889d1137-d647-41c4-8e03-b45094f02d6d with status ACTIVE [ 706.191147] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.191353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.191452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.191667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.191761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.191942] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.192066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.192125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.192271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.192349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.193037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.193276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.193412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.193495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.193574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.193656] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 889d1137-d647-41c4-8e03-b45094f02d6d is going to be updated. [ 706.195050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.195179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.212684] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-17236acd-e51c-4687-94e2-c799bfdf5b4a tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 706.212905] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 706.213320] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.213431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.216060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.216362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.216461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.216856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.216856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.217242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-889d1137-d647-41c4-8e03-b45094f02d6d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.425935] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 706.426153] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade deletion is rescheduled due to dependency. [ 706.426318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.427293] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.427293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.427293] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.625212] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.625402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.625464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.625664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.625849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.626089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.626211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.626347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.626453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.626532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.626618] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 706.653122] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.653524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.653524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.653848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.654160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.664161] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 706.930201] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.337911] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.337911] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.337911] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.338389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.338389] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.339024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.339024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.339024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.339024] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.339293] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.339293] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.339391] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.339495] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.339605] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.339730] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.339879] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.365500] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.365500] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.365500] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.365500] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-29" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.365500] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.365500] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.365500] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365782] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee07e8f-b20e-4168-bbf1-3cc79494f7a0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.434551] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.630622] env[65319]: INFO networking_nsxv3.common.synchronization [None req-132b2642-72be-4a8b-b40f-3cdfda6f6a36 None None] Enqueued Resource ID: f7ee3432-da39-4556-9906-3667e3995e80 with Priority: HIGHEST for action port [ 707.631148] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7ee3432-da39-4556-9906-3667e3995e80 with Priority: HIGHEST for action port [ 707.631438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7ee3432-da39-4556-9906-3667e3995e80 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.631552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7ee3432-da39-4556-9906-3667e3995e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.631630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7ee3432-da39-4556-9906-3667e3995e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.631895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7ee3432-da39-4556-9906-3667e3995e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.631980] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7ee3432-da39-4556-9906-3667e3995e80',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.868922] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.869189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.869319] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.869599] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.869745] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.869896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port aee07e8f-b20e-4168-bbf1-3cc79494f7a0 not found, creating... [ 707.870195] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.870347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.870456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.870896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.870896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.871075] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.871225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.871334] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.871529] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.871657] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.871827] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: aee07e8f-b20e-4168-bbf1-3cc79494f7a0 is going to be created. [ 707.893992] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.894347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.894471] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.894747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.894978] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.895290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.937527] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.937751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.937838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.938106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.938189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.938295] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 707.975469] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.975632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.975632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.975781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.975929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.986954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 708.134534] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7ee3432-da39-4556-9906-3667e3995e80 [ 708.134765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.135019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.135139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.135506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.135506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.135605] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7ee3432-da39-4556-9906-3667e3995e80 already deleted. [ 708.135637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7ee3432-da39-4556-9906-3667e3995e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.674632] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 708.675217] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 deletion is rescheduled due to dependency. [ 708.675217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-9ca25f78-2390-4ee1-8cee-d8fb3560008f service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-9ca25f78-2390-4ee1-8cee-d8fb3560008f service nova] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [req-71ee7b7c-30fd-4091-8f65-67120ed6b054 req-9ca25f78-2390-4ee1-8cee-d8fb3560008f service nova] Enqueued Resource ID: aee07e8f-b20e-4168-bbf1-3cc79494f7a0 with Priority: HIGHEST for action port [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_rules [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 708.747163] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee07e8f-b20e-4168-bbf1-3cc79494f7a0 with Priority: HIGHEST for action port [ 708.747163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.750940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.750940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.750940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.750940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.751157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.751361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.751503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.751546] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee07e8f-b20e-4168-bbf1-3cc79494f7a0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.239115] env[65319]: INFO networking_nsxv3.common.synchronization [None req-52ddd983-e075-47ab-b197-a168880a725f None None] Enqueued Resource ID: 02865ac7-7381-4490-a04c-1a61ebe18de4 with Priority: HIGHEST for action port [ 709.239704] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02865ac7-7381-4490-a04c-1a61ebe18de4 with Priority: HIGHEST for action port [ 709.240046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-02865ac7-7381-4490-a04c-1a61ebe18de4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.240177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02865ac7-7381-4490-a04c-1a61ebe18de4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.240246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02865ac7-7381-4490-a04c-1a61ebe18de4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.240584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02865ac7-7381-4490-a04c-1a61ebe18de4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.240629] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02865ac7-7381-4490-a04c-1a61ebe18de4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.257421] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aee07e8f-b20e-4168-bbf1-3cc79494f7a0 with status ACTIVE [ 709.257720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.257928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.258020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.258238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.258401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.258587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.258695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.259539] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.259539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.259815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.259815] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aee07e8f-b20e-4168-bbf1-3cc79494f7a0 is going to be updated. [ 709.289839] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.290066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.290169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.290408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.290587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.290756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee07e8f-b20e-4168-bbf1-3cc79494f7a0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.651769] env[65319]: INFO networking_nsxv3.common.synchronization [None req-0ff3bb00-6bd9-4060-95a5-d751a797b9d4 None None] Enqueued Resource ID: f22e317e-2017-4625-918b-c966f54d8186 with Priority: HIGHEST for action port [ 709.652204] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f22e317e-2017-4625-918b-c966f54d8186 with Priority: HIGHEST for action port [ 709.652511] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f22e317e-2017-4625-918b-c966f54d8186 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.652628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f22e317e-2017-4625-918b-c966f54d8186" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.652689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f22e317e-2017-4625-918b-c966f54d8186" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.653249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f22e317e-2017-4625-918b-c966f54d8186" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.653249] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f22e317e-2017-4625-918b-c966f54d8186',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.744103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02865ac7-7381-4490-a04c-1a61ebe18de4 [ 709.744354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.744483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.744552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.744761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.744886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.744949] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02865ac7-7381-4490-a04c-1a61ebe18de4 already deleted. [ 709.745055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02865ac7-7381-4490-a04c-1a61ebe18de4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.999831] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 710.000132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.000132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.000348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.000541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.000647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.000710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.000883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.000955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.001054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.001183] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.003922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.004467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.004592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.005980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.007088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.007088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.007088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.007088] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.154931] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f22e317e-2017-4625-918b-c966f54d8186 [ 710.155253] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.155428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.155513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.155884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156146] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f22e317e-2017-4625-918b-c966f54d8186 already deleted. [ 710.156240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f22e317e-2017-4625-918b-c966f54d8186" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.506639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.506639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.509910] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.965304] env[65319]: INFO networking_nsxv3.common.synchronization [None req-59e0d031-9449-4c0e-8b87-fc70a1419ae3 None None] Enqueued Resource ID: 55b2d44e-9005-44bf-9246-60ddf4fe44e8 with Priority: HIGHEST for action port [ 710.965304] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b2d44e-9005-44bf-9246-60ddf4fe44e8 with Priority: HIGHEST for action port [ 710.965304] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-55b2d44e-9005-44bf-9246-60ddf4fe44e8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.965773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55b2d44e-9005-44bf-9246-60ddf4fe44e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.967482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55b2d44e-9005-44bf-9246-60ddf4fe44e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.967893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55b2d44e-9005-44bf-9246-60ddf4fe44e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.968228] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55b2d44e-9005-44bf-9246-60ddf4fe44e8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.011723] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.471489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55b2d44e-9005-44bf-9246-60ddf4fe44e8 [ 711.471904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.472141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.472287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.472502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.472595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.472693] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55b2d44e-9005-44bf-9246-60ddf4fe44e8 already deleted. [ 711.472795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55b2d44e-9005-44bf-9246-60ddf4fe44e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.516283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.516396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.516476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.516674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.517440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.517440] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 711.521611] env[65319]: INFO networking_nsxv3.common.synchronization [None req-701d55a6-4022-4426-94e8-557153a519d9 tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c with Priority: HIGHEST for action security_group_rules [ 711.522179] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c with Priority: HIGHEST for action security_group_rules [ 711.522489] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.522624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.522668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.523140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.523140] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e14a7e0-332a-4e64-848b-6a7a82283b7c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.557420] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.557686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.557686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.558123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.558123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.570965] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 711.774027] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3a430823-2ba2-493d-b381-ac514434d16c None None] Enqueued Resource ID: f72ee9f1-cf00-42a4-b7b8-262c39ec62b3 with Priority: HIGHEST for action port [ 711.774027] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f72ee9f1-cf00-42a4-b7b8-262c39ec62b3 with Priority: HIGHEST for action port [ 711.774433] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f72ee9f1-cf00-42a4-b7b8-262c39ec62b3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.774792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f72ee9f1-cf00-42a4-b7b8-262c39ec62b3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.774940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f72ee9f1-cf00-42a4-b7b8-262c39ec62b3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.775289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f72ee9f1-cf00-42a4-b7b8-262c39ec62b3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.775476] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72ee9f1-cf00-42a4-b7b8-262c39ec62b3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.046479] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.046834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.047364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.047696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.047835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.047954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c already deleted. [ 712.048071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.283413] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f72ee9f1-cf00-42a4-b7b8-262c39ec62b3 [ 712.283662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.283946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.283946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.284193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.284274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.284371] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f72ee9f1-cf00-42a4-b7b8-262c39ec62b3 already deleted. [ 712.284454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f72ee9f1-cf00-42a4-b7b8-262c39ec62b3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.414421] env[65319]: INFO networking_nsxv3.common.synchronization [None req-361ad1c7-982e-4a64-8afb-6dc71ca285f1 tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c with Priority: HIGHEST for action security_group_rules [ 712.414421] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c with Priority: HIGHEST for action security_group_rules [ 712.415656] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.415656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.415656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.415656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.415656] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e14a7e0-332a-4e64-848b-6a7a82283b7c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.938797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.939137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.941068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.941402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.941512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.941622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e14a7e0-332a-4e64-848b-6a7a82283b7c already deleted. [ 712.941708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e14a7e0-332a-4e64-848b-6a7a82283b7c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.006361] env[65319]: INFO networking_nsxv3.common.synchronization [req-13c4c3d7-d3f0-429c-ac4e-5d875882c2c9 req-9eca2023-79e3-4cf6-b04b-ff436761c7b5 tempest-VolumesAssistedSnapshotsTest-925375010 tempest-VolumesAssistedSnapshotsTest-925375010-project-member] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 713.007194] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGHEST for action security_group_members [ 713.007614] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.007780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.007874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.008169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.008397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.008542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.008625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.008846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.008953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.009106] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.270536] env[65319]: INFO networking_nsxv3.common.synchronization [None req-2a45721d-3175-4784-8a5e-734b38cd42ec None None] Enqueued Resource ID: 12e1722a-85ac-4ed6-9a0e-9c5e4f9044be with Priority: HIGHEST for action port [ 713.273207] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e1722a-85ac-4ed6-9a0e-9c5e4f9044be with Priority: HIGHEST for action port [ 713.276654] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e1722a-85ac-4ed6-9a0e-9c5e4f9044be taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.276654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e1722a-85ac-4ed6-9a0e-9c5e4f9044be" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.276654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e1722a-85ac-4ed6-9a0e-9c5e4f9044be" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.276654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e1722a-85ac-4ed6-9a0e-9c5e4f9044be" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.276654] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e1722a-85ac-4ed6-9a0e-9c5e4f9044be',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.511397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.511586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.511755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.511911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.512019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.512217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.512498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.512498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.512553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.512601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.512687] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 is going to be updated. [ 713.543673] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.543846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.543884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.544182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.544405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.553589] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: IN_PROGRESS for 2s [ 713.580971] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 713.581229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.581390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.581619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.581979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.581979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.581979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.582182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.582229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.582320] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.607255] env[65319]: INFO networking_nsxv3.common.synchronization [None req-4096e965-b6e5-4662-80d5-e25d6acf923a tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 713.607255] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 713.607255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.607255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.607255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.608169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.608388] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.766721] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c6f11ca5-1cf4-410d-b437-4d6ade417e70 tempest-ServersV294TestFqdnHostnames-85723109 tempest-ServersV294TestFqdnHostnames-85723109-project-member] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 713.766933] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 713.767481] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.767825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.767825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.768020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.768191] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.780046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e1722a-85ac-4ed6-9a0e-9c5e4f9044be [ 713.780046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.780046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.780046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.780046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.780046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.780046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e1722a-85ac-4ed6-9a0e-9c5e4f9044be already deleted. [ 713.780046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e1722a-85ac-4ed6-9a0e-9c5e4f9044be" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.035915] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7696b441-91a3-46f1-a138-f426a59e26bc tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 714.035915] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 714.035915] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.035915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.086301] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.131644] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.131827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.131929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.132212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.132310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.132430] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 already deleted. [ 714.132530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.132698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.132887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.132993] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.285248] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c8620583-a420-4a07-b3bf-200ae9a488d1 tempest-ServersV294TestFqdnHostnames-85723109 tempest-ServersV294TestFqdnHostnames-85723109-project-member] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 714.286565] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 714.286565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.286565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.291265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.292106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.292217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.292709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.293986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.294155] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 already deleted. [ 714.294266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.295508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.295508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.295508] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.425370] env[65319]: INFO networking_nsxv3.common.synchronization [None req-200d7ab7-9473-4a0a-b7ea-a7eb5895c240 None None] Enqueued Resource ID: 1e9b9351-d4b0-418b-804a-fd83df541cab with Priority: HIGHEST for action port [ 714.426165] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e9b9351-d4b0-418b-804a-fd83df541cab with Priority: HIGHEST for action port [ 714.426897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e9b9351-d4b0-418b-804a-fd83df541cab taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.426897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e9b9351-d4b0-418b-804a-fd83df541cab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.426897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e9b9351-d4b0-418b-804a-fd83df541cab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.427331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e9b9351-d4b0-418b-804a-fd83df541cab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.427475] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9b9351-d4b0-418b-804a-fd83df541cab',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.589955] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.657371] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.658919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.658919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.658919] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 already deleted. [ 714.658919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.803446] env[65319]: INFO networking_nsxv3.common.synchronization [req-95c896d4-7252-4678-96b6-7349d11a94d7 req-3eea530a-1e59-490e-b0ca-16224f294239 tempest-InstanceActionsNegativeTestJSON-1381764177 tempest-InstanceActionsNegativeTestJSON-1381764177-project-member] Enqueued Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 714.808241] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGHEST for action security_group_members [ 714.809090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.809242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.809314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.809532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.809703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.810170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.810170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.810256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.810313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.810393] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.843187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.843483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.843483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.843677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.843796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.844447] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 already deleted. [ 714.844447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.929657] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e9b9351-d4b0-418b-804a-fd83df541cab [ 714.930309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.930497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.930623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.930909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.931031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.931553] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e9b9351-d4b0-418b-804a-fd83df541cab already deleted. [ 714.931553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e9b9351-d4b0-418b-804a-fd83df541cab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.094551] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.094731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.094803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.095029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.095514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.095514] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 715.127711] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.127979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.127979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.128185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.128324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.137505] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 715.312379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.312777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.312777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.315323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.315323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.316296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.316296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.316296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.316504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.316585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.316684] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea is going to be updated. [ 715.357739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.357739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.357739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.358109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.358258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.370044] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: IN_PROGRESS for 2s [ 715.568345] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8289f43-cccf-41f3-8768-9719094a27c3 in Status: SUCCESS [ 715.568588] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 deletion is rescheduled due to dependency. [ 715.568799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.148247] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 717.148735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.148735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.148959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.149246] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.149394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.149468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.149742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.149853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.150089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.150190] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.150322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.150698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.150698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.150841] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.150954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.151092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.151234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.151342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.151505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.151650] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.381243] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea in Status: SUCCESS [ 717.381572] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea deletion is rescheduled due to dependency. [ 717.381632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.579829] env[65319]: INFO networking_nsxv3.common.synchronization [req-78106172-db0f-4455-a9a3-09705509fe46 req-bc8821a6-8b42-4f1f-b89d-961c5b1a17f5 tempest-FloatingIPsAssociationTestJSON-2127283809 tempest-FloatingIPsAssociationTestJSON-2127283809-project-member] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 717.580498] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 717.580693] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.580835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.580900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.581727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.581923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.583140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.583140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.583140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.583140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.583140] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.654647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7803898b-69e4-4d33-860f-8dbb01043ade: rpc.has_security_group_logging(os_id): False [ 717.673536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.673691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.673765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.674034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.674128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.674367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.674475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.674538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.674692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.674771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.674973] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.675088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.675150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.675290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.675365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.675588] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.675680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.675788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.675825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.675896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.675977] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 717.747562] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.747562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.747718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.748163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.748375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.765780] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 717.975605] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.977017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.977017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.977017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.977017] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.977294] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.977546] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.978846] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.979397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.986904] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.986904] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.986904] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.986904] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.986904] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.986904] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.986904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.010121] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.010121] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.010121] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.010121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.010121] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-cd824193-ae15-4f5b-af1c-3903a08f2e89 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.010121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.010121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.010121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.010121] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd824193-ae15-4f5b-af1c-3903a08f2e89',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.087504] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.087775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.087881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.088169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.088295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.088507] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.088626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.088700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.089056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.089056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089056] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b already deleted. [ 718.089240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.511890] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.512196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.512280] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.512544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.512683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.512829] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port cd824193-ae15-4f5b-af1c-3903a08f2e89 not found, creating... [ 718.513141] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.513301] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.513459] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.513700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.513900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.514275] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.514445] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.514639] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.514756] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.514881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.515032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: cd824193-ae15-4f5b-af1c-3903a08f2e89 is going to be created. [ 718.535606] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.535702] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.535772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.536256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.536523] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.537135] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [req-78106172-db0f-4455-a9a3-09705509fe46 req-153b86d4-99cb-40ff-93c6-43a4c3ae2d33 service nova] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_rules [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [req-78106172-db0f-4455-a9a3-09705509fe46 req-153b86d4-99cb-40ff-93c6-43a4c3ae2d33 service nova] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [req-78106172-db0f-4455-a9a3-09705509fe46 req-153b86d4-99cb-40ff-93c6-43a4c3ae2d33 service nova] Enqueued Resource ID: cd824193-ae15-4f5b-af1c-3903a08f2e89 with Priority: HIGHEST for action port [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_rules [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 719.316722] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd824193-ae15-4f5b-af1c-3903a08f2e89 with Priority: HIGHEST for action port [ 719.317332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.317486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.317532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.317769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.317852] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.319508] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.319660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.319756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.319918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.320106] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.320200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.320273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.320414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.320507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.320595] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.321837] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd824193-ae15-4f5b-af1c-3903a08f2e89 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.322020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.322020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.322711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.322805] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd824193-ae15-4f5b-af1c-3903a08f2e89',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.782215] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 719.782497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.782624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.782838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.782927] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.820917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.822045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.824719] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd824193-ae15-4f5b-af1c-3903a08f2e89 with status ACTIVE [ 719.825308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.825308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.825308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.825308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.825487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.826079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.826079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.826079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.826079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.826079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.826959] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.826959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.826959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.826959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.826959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.826959] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd824193-ae15-4f5b-af1c-3903a08f2e89 is going to be updated. [ 719.827860] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.848718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.848859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.848947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.849138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.849270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.849421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd824193-ae15-4f5b-af1c-3903a08f2e89" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.985828] env[65319]: INFO networking_nsxv3.common.synchronization [req-729c86c3-4141-4626-acca-e6a38c8167a0 req-5b24740c-ca94-4d99-90e6-606dcc709312 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 719.986372] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 719.986670] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.986792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.986858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.987306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.987367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.988108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.988279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.988459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.988561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.988661] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.286058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.286215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.286255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.286485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.286699] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.286837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.286924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.287112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.287203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.287292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.287594] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.330268] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.496018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.496018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.496018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.496018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be updated. [ 720.530030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.530030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.530030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.530030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.530030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.539573] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 720.674529] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d1d89c6-33fd-44d3-aba1-e4395b55df94 req-95e3577a-7735-4e6d-a3d6-38b5686eb3f4 tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 720.675121] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 720.676044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.676044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.676044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.676044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.676346] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.676346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.676437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.676556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.676798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.676798] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.790086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.790603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.790603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.790603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.790880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.790966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.791046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.791209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.791327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.791457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.791646] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.791763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.791830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.791946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.792120] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.792197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.792277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.792431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.792507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.792590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.792683] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.834792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.834988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.836903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.836903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.836903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.836903] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be created. [ 720.873635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.873870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.874071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.874329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.874510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.889643] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: UNINITIALIZED for 2s [ 721.179542] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.179542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.179542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.179811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.179811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.180224] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.180224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.180224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.180382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.180382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.180794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b already deleted. [ 721.180794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.295882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7803898b-69e4-4d33-860f-8dbb01043ade: rpc.has_security_group_logging(os_id): False [ 721.333844] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.334118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.334193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.334649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.334649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.334806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.334976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.335063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.335295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.335382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.335653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.335719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.336423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.336423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.336423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.336423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.336423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.336866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.336866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.336866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.337055] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 721.413169] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.413431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.413601] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.414028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.414574] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.414812] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.414936] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.415260] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.415452] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.415946] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.416099] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.416270] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.416434] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.416596] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.416725] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.416895] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.424282] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.424456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.424548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.424792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.424980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.441809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.442172] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.442378] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.442569] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.442946] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-511d5cef-8831-4772-804d-9e6d03b61f52 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.443143] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.443269] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.443639] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.443783] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511d5cef-8831-4772-804d-9e6d03b61f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.446289] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 721.946753] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.947165] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.947165] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.947516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.947721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.947917] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 511d5cef-8831-4772-804d-9e6d03b61f52 not found, creating... [ 721.948262] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.948462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.948626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.948900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.949113] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.949498] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.949677] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.949801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.950055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.950342] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.950418] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 511d5cef-8831-4772-804d-9e6d03b61f52 is going to be created. [ 721.975893] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.976549] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.977044] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.977363] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.977619] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.977917] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.555373] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 722.555493] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 deletion is rescheduled due to dependency. [ 722.555537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.755056] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d1d89c6-33fd-44d3-aba1-e4395b55df94 req-5e588925-e341-4297-a0fd-83baba048b10 service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 722.755353] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d1d89c6-33fd-44d3-aba1-e4395b55df94 req-5e588925-e341-4297-a0fd-83baba048b10 service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 722.755453] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d1d89c6-33fd-44d3-aba1-e4395b55df94 req-5e588925-e341-4297-a0fd-83baba048b10 service nova] Enqueued Resource ID: 511d5cef-8831-4772-804d-9e6d03b61f52 with Priority: HIGHEST for action port [ 722.755905] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 722.756727] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 722.756727] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511d5cef-8831-4772-804d-9e6d03b61f52 with Priority: HIGHEST for action port [ 722.756727] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.756727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.756727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.756948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.756948] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.758633] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.759099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.759099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.759099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.759226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.759281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.759420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.760308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.760308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.760308] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.761609] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-511d5cef-8831-4772-804d-9e6d03b61f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.761609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.761609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.761609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.761609] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511d5cef-8831-4772-804d-9e6d03b61f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.900585] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 722.900762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.900925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.901148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.901337] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.901454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.901518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.901673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.901776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.901883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.901985] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.265687] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.267201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.267201] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.267533] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 511d5cef-8831-4772-804d-9e6d03b61f52 with status ACTIVE [ 723.267818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.268017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.271143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.271480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.271618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.272187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.272187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.272187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.272542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.272542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.272851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.276027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.276027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.276027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.276027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.276027] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 511d5cef-8831-4772-804d-9e6d03b61f52 is going to be updated. [ 723.305182] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.305182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.305182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.305182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.305182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.305182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-511d5cef-8831-4772-804d-9e6d03b61f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.366216] env[65319]: INFO networking_nsxv3.common.synchronization [req-5d065a87-72ee-42e9-920f-3efe917204f1 req-6df5217d-0649-4b94-90ba-75bb2bfdcdc4 tempest-ServerActionsV293TestJSON-1314727380 tempest-ServerActionsV293TestJSON-1314727380-project-member] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 723.366216] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 723.366216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.366216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.366216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.366216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.366216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.366476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.366476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.366539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.366977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.366977] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.406250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.406250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.406250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.406639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.406639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.406639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.406639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.406804] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.406804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.406885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.413688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.413688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.413688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.413688] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.469176] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 723.469453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.780600] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.855229] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.855452] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-90" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.855584] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-90" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.855931] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-90" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.856392] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.856584] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.856701] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.857174] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.857174] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.857405] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.857461] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.858103] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.858103] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.858103] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.858103] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.858103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.871899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.872113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.872113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.873578] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.873578] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30580859-8cff-47d8-a383-cb85009ec257 already deleted. [ 723.873578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.879476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.879476] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.879625] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.879689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-90" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.879975] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-8bc7878d-489c-4bf3-840b-001a1d6cba96 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.880217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.880942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.880942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.880942] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc7878d-489c-4bf3-840b-001a1d6cba96',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.912960] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c15410b-c953-4795-bf47-b964e640b74b: rpc.has_security_group_logging(os_id): False [ 723.933221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.933838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.936314] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.936314] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.936314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.937352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.939694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.939694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.939694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.939694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.939694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be created. [ 724.000762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.000762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.000762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.000762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.000762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.011736] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 724.282239] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.282608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.282608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.282687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.282782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.282884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be created. [ 724.306627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.306627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.306828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.308058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.308058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.317922] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: UNINITIALIZED for 2s [ 724.383682] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.383903] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.384118] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.384514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.384695] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.384809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 8bc7878d-489c-4bf3-840b-001a1d6cba96 not found, creating... [ 724.385143] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.385323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.385435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.385665] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.385799] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.386107] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.386270] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.386379] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.386586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.386715] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.386849] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 8bc7878d-489c-4bf3-840b-001a1d6cba96 is going to be created. [ 724.407579] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.408376] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.408376] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.408376] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.408537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.408734] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.225656] env[65319]: INFO networking_nsxv3.common.synchronization [req-5d065a87-72ee-42e9-920f-3efe917204f1 req-c1d4061b-c990-4452-ab6f-1d3626530282 service nova] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 725.225909] env[65319]: INFO networking_nsxv3.common.synchronization [req-5d065a87-72ee-42e9-920f-3efe917204f1 req-c1d4061b-c990-4452-ab6f-1d3626530282 service nova] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 725.226094] env[65319]: INFO networking_nsxv3.common.synchronization [req-5d065a87-72ee-42e9-920f-3efe917204f1 req-c1d4061b-c990-4452-ab6f-1d3626530282 service nova] Enqueued Resource ID: 8bc7878d-489c-4bf3-840b-001a1d6cba96 with Priority: HIGHEST for action port [ 725.226644] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_rules [ 725.226814] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 725.226936] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bc7878d-489c-4bf3-840b-001a1d6cba96 with Priority: HIGHEST for action port [ 725.227298] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.227406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.227497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.228025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.228025] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.229137] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.229208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.229335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.230265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.230265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.230265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.230265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.230265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.230265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.230265] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.231066] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bc7878d-489c-4bf3-840b-001a1d6cba96 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.231243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.231350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.231523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.232704] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc7878d-489c-4bf3-840b-001a1d6cba96',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.260459] env[65319]: INFO networking_nsxv3.common.synchronization [req-319b0a21-ab8b-4306-94ec-89ad02976e5a req-39a79ba2-a401-4df3-8ebc-34844bc60704 tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 725.261053] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 725.261330] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.261454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.666977] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.667430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.667430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.667894] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.671403] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.671403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.671403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.671403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.672315] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.675145] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.675145] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.675145] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.675145] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.675145] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.675145] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.675145] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.699477] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.699576] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.699720] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.699891] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.700407] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.700631] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.700761] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.701096] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.701260] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf39c4d-1a43-4df8-9cf5-e66539e99cd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.733530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.733697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.733809] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.736992] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bc7878d-489c-4bf3-840b-001a1d6cba96 with status ACTIVE [ 725.737435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.737551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.737551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.737740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.737811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.739658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.739933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.739933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.740249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.740249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.740420] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.740664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.740664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.740783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.740857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.741046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bc7878d-489c-4bf3-840b-001a1d6cba96 is going to be updated. [ 725.765690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.765858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.766083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.767120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.767120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.767120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bc7878d-489c-4bf3-840b-001a1d6cba96" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.028198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 726.028627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.204500] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.204928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.206037] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.206037] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.206037] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.206037] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 not found, creating... [ 726.206429] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.206828] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.207015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.207528] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.207723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.208133] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.208391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.208615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.208954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.209194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.209406] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 is going to be created. [ 726.232578] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.232889] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.233043] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.233320] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.233646] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.233879] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.245149] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.329766] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 726.329917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.330379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.330379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.330573] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.330723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.330761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.331092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.331092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.331092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.331228] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.333277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.333277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.333277] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.333459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.333459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.333568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.333601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.333703] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.747865] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.748177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.748177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.748488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.748559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.748624] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30580859-8cff-47d8-a383-cb85009ec257 is going to be created. [ 726.785828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.786032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.786079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.786289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.786456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.800859] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: UNINITIALIZED for 2s [ 726.833516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.833715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.836225] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.942131] env[65319]: INFO networking_nsxv3.common.synchronization [req-319b0a21-ab8b-4306-94ec-89ad02976e5a req-2417f89a-b168-4216-aae2-caf257b2fa2a service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 726.942290] env[65319]: INFO networking_nsxv3.common.synchronization [req-319b0a21-ab8b-4306-94ec-89ad02976e5a req-2417f89a-b168-4216-aae2-caf257b2fa2a service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 726.942364] env[65319]: INFO networking_nsxv3.common.synchronization [req-319b0a21-ab8b-4306-94ec-89ad02976e5a req-2417f89a-b168-4216-aae2-caf257b2fa2a service nova] Enqueued Resource ID: 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 with Priority: HIGHEST for action port [ 726.943116] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 726.943213] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 726.943352] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 with Priority: HIGHEST for action port [ 726.943648] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.943756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.943953] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.944118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.944312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.944413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.944480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.944676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.944756] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf39c4d-1a43-4df8-9cf5-e66539e99cd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.339580] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.446705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 with status ACTIVE [ 727.447935] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.447935] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.447935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.448327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.448327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.448436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.448613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.448710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.448934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.449437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.449437] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cf39c4d-1a43-4df8-9cf5-e66539e99cd4 is going to be updated. [ 727.476498] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.476745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.476745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.476991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.477233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.477434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cf39c4d-1a43-4df8-9cf5-e66539e99cd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.706689] env[65319]: INFO networking_nsxv3.common.synchronization [None req-9986fdb4-e965-43da-b721-8a2da92fed0d None None] Enqueued Resource ID: 26db831e-bdd8-47fc-9f92-bbf593091cc0 with Priority: HIGHEST for action port [ 727.707324] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26db831e-bdd8-47fc-9f92-bbf593091cc0 with Priority: HIGHEST for action port [ 727.707632] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-26db831e-bdd8-47fc-9f92-bbf593091cc0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.707796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26db831e-bdd8-47fc-9f92-bbf593091cc0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.707987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26db831e-bdd8-47fc-9f92-bbf593091cc0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.708113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26db831e-bdd8-47fc-9f92-bbf593091cc0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.708201] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26db831e-bdd8-47fc-9f92-bbf593091cc0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.845374] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.845849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.845849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.846166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.846249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.846376] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 727.893505] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.893663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.893740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.894183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.894384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.908739] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 727.935037] env[65319]: INFO networking_nsxv3.common.synchronization [req-21118c88-e5e8-4021-9795-8c5803b265c5 req-07633b6b-ed43-43c3-abd8-8431df877fff tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 727.935726] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 727.936064] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.936183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.213030] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26db831e-bdd8-47fc-9f92-bbf593091cc0 [ 728.213030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.213030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.213030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.213030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.213030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.213030] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26db831e-bdd8-47fc-9f92-bbf593091cc0 already deleted. [ 728.213030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26db831e-bdd8-47fc-9f92-bbf593091cc0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.450850] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.450850] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.450850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.450850] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.450850] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.450850] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.451412] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.451445] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.451661] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.451898] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.472886] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.473083] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.473286] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.473482] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.473801] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-ab252fa8-1409-436b-b065-190781c95c8d taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.474104] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.474240] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.474530] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.474687] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab252fa8-1409-436b-b065-190781c95c8d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.812727] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: SUCCESS [ 728.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.813457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.813670] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.813860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.813917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.814117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.814222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.814460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.814460] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.977455] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.977876] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.977876] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.979026] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.979026] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.979026] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port ab252fa8-1409-436b-b065-190781c95c8d not found, creating... [ 728.979026] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.979026] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.979026] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.979382] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.979382] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.979457] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.979604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.979715] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.979919] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.980060] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.980300] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: ab252fa8-1409-436b-b065-190781c95c8d is going to be created. [ 729.006029] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.006275] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.006410] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.006715] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.006939] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.007191] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.316991] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [req-21118c88-e5e8-4021-9795-8c5803b265c5 req-7529f8ba-d89a-48b3-9556-549f673df351 service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [req-21118c88-e5e8-4021-9795-8c5803b265c5 req-7529f8ba-d89a-48b3-9556-549f673df351 service nova] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [req-21118c88-e5e8-4021-9795-8c5803b265c5 req-7529f8ba-d89a-48b3-9556-549f673df351 service nova] Enqueued Resource ID: ab252fa8-1409-436b-b065-190781c95c8d with Priority: HIGHEST for action port [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_rules [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 729.746230] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab252fa8-1409-436b-b065-190781c95c8d with Priority: HIGHEST for action port [ 729.746709] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.746928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.747261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.747464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.747787] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab252fa8-1409-436b-b065-190781c95c8d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.748616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.748759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.749052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.749347] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab252fa8-1409-436b-b065-190781c95c8d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.819999] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30580859-8cff-47d8-a383-cb85009ec257: rpc.has_security_group_logging(os_id): False [ 729.845427] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.845886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.846415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.848522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.848522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.848522] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30580859-8cff-47d8-a383-cb85009ec257 is going to be created. [ 729.924206] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.924206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.924206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.924451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.924691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.926811] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 729.927056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.928696] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.928696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.928696] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.929731] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.929731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.930840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.930840] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.931433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.931433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.931740] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.931956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.932728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.932728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.932728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.932728] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.944767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: IN_PROGRESS for 2s [ 730.252044] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab252fa8-1409-436b-b065-190781c95c8d with status ACTIVE [ 730.252380] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.252380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.252380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.252729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.252879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.253165] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.253338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.253482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.253667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.253784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.254076] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.254245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.254376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.254640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.254793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.255285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab252fa8-1409-436b-b065-190781c95c8d is going to be updated. [ 730.283714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.283872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.283943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.284295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.284473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.284646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab252fa8-1409-436b-b065-190781c95c8d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.436073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b: rpc.has_security_group_logging(os_id): False [ 730.437463] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.470917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.471101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.471188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.471408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.471537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.471697] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.471807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.471859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.472061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.472174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.472369] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.472464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.472527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.472661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.472737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.472931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.473156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.473261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.473439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.473601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.473705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be created. [ 730.543774] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.544056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.544056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.544859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.544859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.560133] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 730.703668] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f833d51e-1808-4298-967a-b671890ece1e None None] Enqueued Resource ID: fb28b3a4-0caa-478f-9d8c-7bfef972106a with Priority: HIGHEST for action port [ 730.704071] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb28b3a4-0caa-478f-9d8c-7bfef972106a with Priority: HIGHEST for action port [ 730.704393] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb28b3a4-0caa-478f-9d8c-7bfef972106a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.704522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb28b3a4-0caa-478f-9d8c-7bfef972106a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.704578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb28b3a4-0caa-478f-9d8c-7bfef972106a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.704841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb28b3a4-0caa-478f-9d8c-7bfef972106a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.704921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb28b3a4-0caa-478f-9d8c-7bfef972106a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.840181] env[65319]: INFO networking_nsxv3.common.synchronization [req-16e167c8-611e-4e2f-8ba3-847c9706b378 req-79583023-c544-4464-b801-6702c761bb7b tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 730.840285] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 730.841846] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.842030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.842083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.842477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.842546] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.842603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.842693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.843402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.843402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.843551] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.944472] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.208368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb28b3a4-0caa-478f-9d8c-7bfef972106a [ 731.208622] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.208760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.208852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.209113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.209438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.209438] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb28b3a4-0caa-478f-9d8c-7bfef972106a already deleted. [ 731.209438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb28b3a4-0caa-478f-9d8c-7bfef972106a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.231076] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.231076] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.231076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.231556] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.231556] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.231556] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.231636] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.231841] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.231841] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.232018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.262662] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.262662] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.263064] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.263064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.263337] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-1fe3a653-f753-43d0-bc4b-4b919fa905d2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.263511] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.263625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.264070] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.264226] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fe3a653-f753-43d0-bc4b-4b919fa905d2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.346980] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.447157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.447366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.447443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.447693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.447794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.447893] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 731.481560] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.481819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.481819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.481941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.482157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.492565] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 731.767083] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.767083] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.767083] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.767377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.767520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.767686] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 1fe3a653-f753-43d0-bc4b-4b919fa905d2 not found, creating... [ 731.767965] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.768178] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.768307] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.768535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.768669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.768956] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.769128] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.769241] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.769449] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.769590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.770544] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 1fe3a653-f753-43d0-bc4b-4b919fa905d2 is going to be created. [ 731.826848] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.827560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.827560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.827686] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.827912] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.828214] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.849086] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.959902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: SUCCESS [ 731.960310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.352245] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.352480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.352480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.352736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.352830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.352953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 732.382585] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.382773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.382817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.383016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.383166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.397873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 732.499715] env[65319]: INFO networking_nsxv3.common.synchronization [req-16e167c8-611e-4e2f-8ba3-847c9706b378 req-d7cfa70d-cb5f-47e8-9010-7e1e9949de47 service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 732.499901] env[65319]: INFO networking_nsxv3.common.synchronization [req-16e167c8-611e-4e2f-8ba3-847c9706b378 req-d7cfa70d-cb5f-47e8-9010-7e1e9949de47 service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 732.500049] env[65319]: INFO networking_nsxv3.common.synchronization [req-16e167c8-611e-4e2f-8ba3-847c9706b378 req-d7cfa70d-cb5f-47e8-9010-7e1e9949de47 service nova] Enqueued Resource ID: 1fe3a653-f753-43d0-bc4b-4b919fa905d2 with Priority: HIGHEST for action port [ 732.500677] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 732.500825] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 732.500921] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe3a653-f753-43d0-bc4b-4b919fa905d2 with Priority: HIGHEST for action port [ 732.501847] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.502095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.502186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.502392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.502473] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.503602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.503731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504671] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fe3a653-f753-43d0-bc4b-4b919fa905d2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.504671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.504671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.504671] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fe3a653-f753-43d0-bc4b-4b919fa905d2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.573496] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 732.573496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.573867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.574062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.574279] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.007027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.007272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.009664] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fe3a653-f753-43d0-bc4b-4b919fa905d2 with status ACTIVE [ 733.009868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.009988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.010074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.010299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.010392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.010605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.010660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.010726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.010879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.010958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.011153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.011252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.011315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.011453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.011529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.011614] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fe3a653-f753-43d0-bc4b-4b919fa905d2 is going to be updated. [ 733.040926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.041158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.041236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.042032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.042032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.042032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fe3a653-f753-43d0-bc4b-4b919fa905d2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.076680] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.076823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.379519] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c7451d3-55f2-4b30-8dd5-204a4f670548 req-0f6998f3-9ea8-44db-b239-7723f77f6919 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 733.380209] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 733.380541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.380674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.380732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.380987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.381156] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.381279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.381453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.381525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.381666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.382047] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.504945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.507163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.507163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.507163] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.746400] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.746599] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-538" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.746717] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-538" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.747064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-538" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.747374] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.747487] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.747595] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.747807] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.747942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.748153] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.748262] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.748364] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.748461] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.748563] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.748658] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.748783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.772381] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.772568] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.772673] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.772845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-538" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.773201] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-8b1c7689-5943-46c9-9b05-0929713f0a53 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.773377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.773519] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.773843] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.773978] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1c7689-5943-46c9-9b05-0929713f0a53',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.884756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.884987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.885091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.885317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.885425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.885629] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.885731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.885796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.885937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.886020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.886106] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 already deleted. [ 733.886193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.010263] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.277222] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.277538] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.277668] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.277955] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.278120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.278279] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 8b1c7689-5943-46c9-9b05-0929713f0a53 not found, creating... [ 734.278557] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.278706] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.278816] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.279043] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.279184] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.279475] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.279629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.279728] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.279928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.280067] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.280204] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 is going to be created. [ 734.301933] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.302244] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.302408] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.302688] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.302914] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.303187] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.418309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 734.418627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.418716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.418951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.419154] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.419278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.419344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.419500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.419582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.419677] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.512425] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.922712] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.015022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.015282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.015386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.015662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.015759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.015863] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 735.053650] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c7451d3-55f2-4b30-8dd5-204a4f670548 req-d8b089ef-720f-40f7-bfa4-85809baadb5b service nova] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 735.053894] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c7451d3-55f2-4b30-8dd5-204a4f670548 req-d8b089ef-720f-40f7-bfa4-85809baadb5b service nova] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 735.054241] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c7451d3-55f2-4b30-8dd5-204a4f670548 req-d8b089ef-720f-40f7-bfa4-85809baadb5b service nova] Enqueued Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 735.055807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.055889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.055926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.057113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.057113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.058276] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 735.058436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 735.058539] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 735.058850] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.058956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.059085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.059228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.059330] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.060342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.060453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.060522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.063364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.063364] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.063364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1c7689-5943-46c9-9b05-0929713f0a53 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.063364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.063364] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1c7689-5943-46c9-9b05-0929713f0a53',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.074260] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 735.425974] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.565578] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.565813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.566172] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.567611] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1c7689-5943-46c9-9b05-0929713f0a53 with status ACTIVE [ 735.568294] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.568294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.568294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.568837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.568837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.569100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.569279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.569348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.569581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.569711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.570043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.570200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.570619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.570619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.570709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.570800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 is going to be updated. [ 735.598240] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.598444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.598489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.598687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.598826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.599036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.928562] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.928768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.928846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.929022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.929112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.929219] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 735.967786] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.967974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.968030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.968254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.968408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.978783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 736.075228] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.576828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.577206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.577345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.577640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.577780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.578138] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be created. [ 736.612610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.612865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.612978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.613434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.613679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.628324] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: UNINITIALIZED for 2s [ 736.849189] env[65319]: INFO networking_nsxv3.common.synchronization [None req-502ae638-37b6-40c1-8559-8ac0250a0534 tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 with Priority: HIGHEST for action security_group_rules [ 736.849901] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 with Priority: HIGHEST for action security_group_rules [ 736.850558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.850748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.851716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.851716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.851716] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26b11568-f507-4cfe-93a7-ea1e5e6fe911',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.001924] env[65319]: INFO networking_nsxv3.common.synchronization [None req-cd9295d7-67ff-4054-8cf9-bdd3d500b33c tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 with Priority: HIGHEST for action security_group_rules [ 737.003281] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 with Priority: HIGHEST for action security_group_rules [ 737.004114] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.004376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.090118] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.090118] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.090118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.090118] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.390455] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.390642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.390682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.391270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.391397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.391506] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 already deleted. [ 737.391593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.391868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.392137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.392253] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26b11568-f507-4cfe-93a7-ea1e5e6fe911',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.593123] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.919635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.919635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.919635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.919635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.919635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.919635] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26b11568-f507-4cfe-93a7-ea1e5e6fe911 already deleted. [ 737.919635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26b11568-f507-4cfe-93a7-ea1e5e6fe911" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.994379] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 737.994617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.994812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.995033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.995262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.995385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.995471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.997040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.997141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.997257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.997357] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.096131] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.503587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.503784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.503824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.504135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.504377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.504522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.504605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.504834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.504950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.505524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.505524] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.505524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.505524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.505866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.505866] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.505957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.506470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.506470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.506470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.506470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.506713] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.599111] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.599600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.600863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.600863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.600863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.600863] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 738.637586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.638305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.638305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.638691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.638691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.640380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 738.640571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.641110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.641317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.641501] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.641618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.641672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.641824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.641969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.642045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.642177] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.648250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 738.857808] env[65319]: INFO networking_nsxv3.common.synchronization [req-3f8751ec-c2ad-40c4-95ba-38d03575211f req-75a3224a-2d79-456d-b44c-9b65e8f69258 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: ca58a93a-a41d-4ec7-b8f3-de5ec8839988 with Priority: HIGHEST for action security_group_rules [ 738.858898] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca58a93a-a41d-4ec7-b8f3-de5ec8839988 with Priority: HIGHEST for action security_group_rules [ 738.859288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca58a93a-a41d-4ec7-b8f3-de5ec8839988 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.859415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca58a93a-a41d-4ec7-b8f3-de5ec8839988" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.859488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca58a93a-a41d-4ec7-b8f3-de5ec8839988" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.860453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca58a93a-a41d-4ec7-b8f3-de5ec8839988" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.860558] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca58a93a-a41d-4ec7-b8f3-de5ec8839988',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.011977] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31328668-cad5-4bcc-9c72-54d3bf9877fe: rpc.has_security_group_logging(os_id): False [ 739.044280] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.044280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.044280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.044280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.044280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.044280] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.044528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.044528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.044672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.044756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.044947] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.045092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.045168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.045322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.045398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.045586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.045674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.045742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.045865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.045941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.047942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 739.127025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.127025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.127025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.127025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.127025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.141801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 739.144522] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.383174] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.383411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.383411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.383993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.383993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.383993] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca58a93a-a41d-4ec7-b8f3-de5ec8839988 already deleted. [ 739.383993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca58a93a-a41d-4ec7-b8f3-de5ec8839988" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.649428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b6be49-7325-4aa1-a882-59916b0da354: rpc.has_security_group_logging(os_id): False [ 739.672809] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.673021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.673101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.673299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.673444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.674531] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.674664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.674855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.674966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.675139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.675246] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be created. [ 739.748823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.749349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.749477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.749651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.750030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.763501] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 740.414350] env[65319]: INFO networking_nsxv3.common.synchronization [req-f029f79b-9dee-421b-b3b4-24481c9cff7f req-5a3bf732-b2e1-43d0-a8c9-96592f51e593 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 740.415337] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 740.416067] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.416067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.416067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.416645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.416898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.417069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.417265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.417433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.417550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.417656] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.662093] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 740.662364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.662514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.662724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.663917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.663917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.663917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.663917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.663917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.663917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.663917] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.921324] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.159799] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 741.160116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.167502] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.167734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.170098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.170098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.170098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.170098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.174147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.174336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.174542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.174657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.174765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.174873] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.425878] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.570283] env[65319]: INFO networking_nsxv3.common.synchronization [req-2308749c-e01e-4d55-88cc-3091f834b1e1 req-bdccc29e-aa56-412f-aade-748d4f1be82c tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 741.571197] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 741.571778] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.572078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.572302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.572717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.573088] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.573305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.573523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.573828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.574030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.574252] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.646334] env[65319]: INFO networking_nsxv3.common.synchronization [req-c7e451e0-1ba9-4a34-8b63-4fb1c5d4a7b3 req-52d35389-8ec3-46a4-ad69-2d7bdabea152 tempest-MultipleCreateTestJSON-1515698715 tempest-MultipleCreateTestJSON-1515698715-project-member] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 741.646334] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGHEST for action security_group_members [ 741.648028] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.648471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.677939] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b: rpc.has_security_group_logging(os_id): False [ 741.834991] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 741.835292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.836288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.836426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.836498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.836742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.836850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.839736] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.839736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.839736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.839988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.839988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.841039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.841039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.841039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.841039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.841039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.841283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.841389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.841452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.841597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.841676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.842355] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 741.929166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.929166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.929166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.929434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.929434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.929507] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 741.973314] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.973874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.974081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.974459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.975155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.005748] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.005984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.006052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.006289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.008281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.013768] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 742.025932] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 742.077811] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.243383] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.243383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.243731] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.243950] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.244422] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.244601] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.244712] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.244981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.245189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.245430] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.245532] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.245635] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.245739] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.245865] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.245962] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.246130] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.269212] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.269309] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.269500] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.269733] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-778" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.270037] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-8dfc322e-e2e9-4f60-9309-5094655b3a08 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.270228] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.270509] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.271130] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.271130] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfc322e-e2e9-4f60-9309-5094655b3a08',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.582841] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.774886] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.774886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.774886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.774886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.774886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.774886] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 8dfc322e-e2e9-4f60-9309-5094655b3a08 not found, creating... [ 742.775741] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.775741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.775741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.775741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.775741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.775970] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.776409] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.776409] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.776514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.776635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.776718] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 is going to be created. [ 742.804252] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.804525] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.804643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.804920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.805199] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.805467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.086627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.086861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.086861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.086989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.087128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.087208] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 743.123156] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.123444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.123444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.123740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.124036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.137580] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 743.568918] env[65319]: INFO networking_nsxv3.common.synchronization [req-2308749c-e01e-4d55-88cc-3091f834b1e1 req-cfe1b62a-8c9d-46ea-ab0a-e7e1464b0c49 service nova] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 743.568918] env[65319]: INFO networking_nsxv3.common.synchronization [req-2308749c-e01e-4d55-88cc-3091f834b1e1 req-cfe1b62a-8c9d-46ea-ab0a-e7e1464b0c49 service nova] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 743.569571] env[65319]: INFO networking_nsxv3.common.synchronization [req-2308749c-e01e-4d55-88cc-3091f834b1e1 req-cfe1b62a-8c9d-46ea-ab0a-e7e1464b0c49 service nova] Enqueued Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 743.570332] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 743.570634] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 743.574044] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 743.574044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.574044] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.574044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.574044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dfc322e-e2e9-4f60-9309-5094655b3a08 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.574044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.575356] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfc322e-e2e9-4f60-9309-5094655b3a08',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.025597] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 744.025953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.026488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.026488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.026488] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.037835] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.037835] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.037835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.038324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.038324] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.077538] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.080255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.080255] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dfc322e-e2e9-4f60-9309-5094655b3a08 with status ACTIVE [ 744.080255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.080255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.080255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.082205] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.082205] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.082205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.082574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.082574] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 is going to be updated. [ 744.116092] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.116307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.116410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.116634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.116821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.117063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.197953] env[65319]: INFO networking_nsxv3.common.synchronization [req-82550010-64f8-437e-b41d-46812e207589 req-d32c6499-a999-43a7-bf77-93d5099893b4 tempest-ServersNegativeTestMultiTenantJSON-623965024 tempest-ServersNegativeTestMultiTenantJSON-623965024-project-member] Enqueued Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 744.198560] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 744.199119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.199297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.199453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.199777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.200227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.200375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.200470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.200764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.200901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.201422] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.529864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.530166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.530291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.530524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.530693] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.530806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.530872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.531073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.531140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.531234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.531331] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.540288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.540470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.540535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.541060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.541181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.541274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.541462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.541581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.541719] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be updated. [ 744.572233] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.572447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.572525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.572831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.573020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.583018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: IN_PROGRESS for 2s [ 744.703264] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.703463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.703463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.703701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.703794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.703997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.704159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.704230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.704423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.704504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.704589] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 already deleted. [ 744.704671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.019034] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.019034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.019034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.019034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.019034] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.019034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.019034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.019380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.019380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.019516] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.019622] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.019724] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.019823] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.019923] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.020029] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.020158] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.033375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.033711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.033711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.033821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.033962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.034124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.034577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.034577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.034577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.034577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.034747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.034747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.034852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.034933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.035062] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.035173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.035236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.035382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.035459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.035538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.035627] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.054642] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.054798] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.054932] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.055253] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-459" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.055587] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-9d8f396e-d291-4bcb-8873-dc76a85c2054 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.055752] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.055866] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.056199] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.056332] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8f396e-d291-4bcb-8873-dc76a85c2054',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.148505] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 745.148799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.148918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.149158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.149356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.149503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.149554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.149752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.149795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.149877] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.537656] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b: rpc.has_security_group_logging(os_id): False [ 745.555527] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.555745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.555745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.555978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.556094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.556378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.556648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.556773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.556985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.557302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.557403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.557466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.557613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.557884] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.557980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.558049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.558191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.558267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.558350] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 745.559744] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.559915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.560043] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.560258] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.560397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.560533] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 9d8f396e-d291-4bcb-8873-dc76a85c2054 not found, creating... [ 745.560784] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.560925] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.561049] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.561675] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.561824] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.561935] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.562197] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.562334] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.562468] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 9d8f396e-d291-4bcb-8873-dc76a85c2054 is going to be created. [ 745.586905] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.587137] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.587259] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.587522] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.587742] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.587965] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.625029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.625269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.625316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.625537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.625864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.639614] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 745.652050] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.154462] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.298934] env[65319]: INFO networking_nsxv3.common.synchronization [req-82550010-64f8-437e-b41d-46812e207589 req-9988ff51-a9e6-4ab9-8260-6810dca00dfe service nova] Enqueued Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_rules [ 746.299124] env[65319]: INFO networking_nsxv3.common.synchronization [req-82550010-64f8-437e-b41d-46812e207589 req-9988ff51-a9e6-4ab9-8260-6810dca00dfe service nova] Enqueued Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 746.299256] env[65319]: INFO networking_nsxv3.common.synchronization [req-82550010-64f8-437e-b41d-46812e207589 req-9988ff51-a9e6-4ab9-8260-6810dca00dfe service nova] Enqueued Resource ID: 9d8f396e-d291-4bcb-8873-dc76a85c2054 with Priority: HIGHEST for action port [ 746.299480] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_rules [ 746.299626] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 746.299751] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8f396e-d291-4bcb-8873-dc76a85c2054 with Priority: HIGHEST for action port [ 746.300317] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.300439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.300504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.300762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.300841] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.304093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.305104] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.305104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.305104] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.308111] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8f396e-d291-4bcb-8873-dc76a85c2054 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.308628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.308628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.308628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.308628] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8f396e-d291-4bcb-8873-dc76a85c2054',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.593578] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7803898b-69e4-4d33-860f-8dbb01043ade in Status: SUCCESS [ 746.593578] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade deletion is rescheduled due to dependency. [ 746.593578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.659443] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.659443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.659443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.659443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.659443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.659443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 746.689823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.689987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.690162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.690510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.691232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.703622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 746.811777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.811862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.812136] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.813062] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d8f396e-d291-4bcb-8873-dc76a85c2054 with status ACTIVE [ 746.813257] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.813406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.813455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.813637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.813745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.813933] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.814052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.814302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.814425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.814425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.814612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.814688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.814863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.814914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.815131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.817620] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d8f396e-d291-4bcb-8873-dc76a85c2054 is going to be updated. [ 746.848594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.848772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.848842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.849102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.849260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.849432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8f396e-d291-4bcb-8873-dc76a85c2054" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.319802] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.658097] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 747.658097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.824789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.825030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.825117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.825352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.825469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.825577] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 is going to be created. [ 747.853587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.853587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.853587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.853901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.853901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.869504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: UNINITIALIZED for 2s [ 748.109842] env[65319]: INFO networking_nsxv3.common.synchronization [req-e4615e43-3db6-41b0-8fd4-b3d5a8d37d07 req-08c450b6-f6aa-4b28-97d8-e89e779cead5 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: df307be8-3408-432e-ae70-edcf7b5a1254 with Priority: HIGHEST for action security_group_rules [ 748.109842] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df307be8-3408-432e-ae70-edcf7b5a1254 with Priority: HIGHEST for action security_group_rules [ 748.110356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df307be8-3408-432e-ae70-edcf7b5a1254 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.110356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df307be8-3408-432e-ae70-edcf7b5a1254" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.110469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df307be8-3408-432e-ae70-edcf7b5a1254" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.111082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df307be8-3408-432e-ae70-edcf7b5a1254" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.111082] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df307be8-3408-432e-ae70-edcf7b5a1254',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.633064] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.633434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.633434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.633534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.633579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.633666] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df307be8-3408-432e-ae70-edcf7b5a1254 already deleted. [ 748.633746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df307be8-3408-432e-ae70-edcf7b5a1254" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.715211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 748.716194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.716384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.716611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.716806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.716936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.717044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.717166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.718173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.718173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.718173] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.220100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.220343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.220343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.220622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.220758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.220898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.220953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.221360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.221620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.221714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.221780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.221931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.222163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.222259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.222372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.222469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.222641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.222641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.222724] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.324265] env[65319]: INFO networking_nsxv3.common.synchronization [req-741dab6a-cca5-43d1-a181-48921fd46147 req-fb40129a-b1e6-421e-94da-fd925f372077 tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 749.324777] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 749.325266] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.325819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.325819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.325819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.329066] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.329066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.329066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.329066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.329066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.329066] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.685544] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.685544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.685922] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.686028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.686281] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.686430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.686537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.686750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.686898] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.687593] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.687738] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.687868] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.688015] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.688105] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.688211] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.688332] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.710545] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.710696] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.710832] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.711026] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.711651] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-70960b46-9752-4fce-8cbe-778a9f785c2c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.712220] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.712220] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.712340] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.713041] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70960b46-9752-4fce-8cbe-778a9f785c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.724548] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 749.742745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.742866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.742951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.743178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.743272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.743587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.743587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.743716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.743829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.743866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.744040] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.744162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.744250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.744374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.744450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.744627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.744722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.744783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.744920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.744994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.745131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 749.813160] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.813160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.813160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.813160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.813160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.828762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.828970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.828970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.829358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.829358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.829593] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.829593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.829743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.830470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.830470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.830470] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 already deleted. [ 749.830470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.831617] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 749.888983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: SUCCESS [ 749.889067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.889289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.889506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.889708] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.889838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.889902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.890093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.890187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.890411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.890411] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.217120] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.217120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.217120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.217530] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.217638] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.217816] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 70960b46-9752-4fce-8cbe-778a9f785c2c not found, creating... [ 750.218145] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.218380] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.218485] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.218892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.218995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.219296] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.219425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.219512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.219724] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.220357] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.220357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 70960b46-9752-4fce-8cbe-778a9f785c2c is going to be created. [ 750.244997] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.245178] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.245270] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.245500] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.245736] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.246017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.392700] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.392938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.393104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.393596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.393877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.394037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.394151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.394358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.394455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.394547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.395607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.395607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.395607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.396240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.396240] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.698637] env[65319]: INFO networking_nsxv3.common.synchronization [req-b8722c9c-d002-47d7-b051-b314fd3d28fc req-d2fb122f-4df1-4bfa-957e-247ce0c92e63 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 750.699181] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 750.699565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.700229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.700229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.700229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.700229] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.700427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.700427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.700508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.700600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.700731] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.898431] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1c365c2-b0da-43cf-8088-9c38fa4c5ec9: rpc.has_security_group_logging(os_id): False [ 750.928516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.928985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.929164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.929453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.929699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.929816] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.930040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.930149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.930498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.930614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.931289] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.931450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.931544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.931632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.931704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.931969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.932114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.932170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.932323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.932421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.932528] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 is going to be created. [ 750.998370] env[65319]: INFO networking_nsxv3.common.synchronization [req-741dab6a-cca5-43d1-a181-48921fd46147 req-2812cd8b-80f9-4838-9f4b-f92c70b14849 service nova] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 750.998370] env[65319]: INFO networking_nsxv3.common.synchronization [req-741dab6a-cca5-43d1-a181-48921fd46147 req-2812cd8b-80f9-4838-9f4b-f92c70b14849 service nova] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 750.998370] env[65319]: INFO networking_nsxv3.common.synchronization [req-741dab6a-cca5-43d1-a181-48921fd46147 req-2812cd8b-80f9-4838-9f4b-f92c70b14849 service nova] Enqueued Resource ID: 70960b46-9752-4fce-8cbe-778a9f785c2c with Priority: HIGHEST for action port [ 750.998643] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 750.999084] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 750.999084] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70960b46-9752-4fce-8cbe-778a9f785c2c with Priority: HIGHEST for action port [ 751.002368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.003030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.003030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.003030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.003030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.008268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.008395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.008450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.008735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.008735] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.009832] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.010026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.010877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.010877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.010994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.011867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.011867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.012125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.012157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.013166] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.017506] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-70960b46-9752-4fce-8cbe-778a9f785c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.017506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.017506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.017506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.017735] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70960b46-9752-4fce-8cbe-778a9f785c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.034319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: IN_PROGRESS for 2s [ 751.203356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.203570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.203641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.203901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.204038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.204324] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.204481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.204565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.204785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.204888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.205011] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 751.238759] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.238956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.239026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.239225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.240088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.250527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 751.282497] env[65319]: INFO networking_nsxv3.common.synchronization [req-7d2c8793-47ae-4841-9fc6-e7af927a201d req-c0fe7998-1542-4faa-b252-f390ea50d057 tempest-ServersTestManualDisk-63027693 tempest-ServersTestManualDisk-63027693-project-member] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 751.283190] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGHEST for action security_group_members [ 751.283550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.283731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.283788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.284128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.284377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.284738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.284738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.284878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.284878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.284970] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.519769] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.521721] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.524219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.525260] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70960b46-9752-4fce-8cbe-778a9f785c2c with status ACTIVE [ 751.525260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.525260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.525260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.525482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.525541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.526362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.526362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.526362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.526362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.526362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.526362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.526665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.526665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.526665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.526665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.526770] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70960b46-9752-4fce-8cbe-778a9f785c2c is going to be updated. [ 751.552317] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.552567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.552727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.553076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.553305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.553590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.788158] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.788738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.788738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.788881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.788881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.789121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.789269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.789322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.789445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.789521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.789645] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 is going to be updated. [ 751.849593] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.850399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.851073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.851073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.851073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.861684] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 751.863056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.868244] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: IN_PROGRESS for 2s [ 752.025576] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.527740] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.528035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.528035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.528945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.528945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.528945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be created. [ 752.557983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.558357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.558357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.558438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.558593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.572942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: UNINITIALIZED for 2s [ 752.708645] env[65319]: INFO networking_nsxv3.common.synchronization [req-e3c667c5-e426-4efb-9053-3e5f62f6c636 req-b1d613af-6223-4609-917c-8e6480f2b4e7 tempest-ImagesOneServerTestJSON-388707046 tempest-ImagesOneServerTestJSON-388707046-project-member] Enqueued Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 752.708645] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGHEST for action security_group_members [ 752.712908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.712908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.712908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.712908] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.044873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: SUCCESS [ 753.044873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.161185] env[65319]: INFO networking_nsxv3.common.synchronization [None req-667961ca-6ad2-41ac-9af1-378da96437b3 None None] Enqueued Resource ID: 59198afd-c9ef-4be3-9692-377642c3e580 with Priority: HIGHEST for action port [ 753.161185] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59198afd-c9ef-4be3-9692-377642c3e580 with Priority: HIGHEST for action port [ 753.161185] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-59198afd-c9ef-4be3-9692-377642c3e580 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.161185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59198afd-c9ef-4be3-9692-377642c3e580" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.161185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59198afd-c9ef-4be3-9692-377642c3e580" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.161185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59198afd-c9ef-4be3-9692-377642c3e580" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.161185] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59198afd-c9ef-4be3-9692-377642c3e580',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.216221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.216221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.216221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.216221] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 is going to be updated. [ 753.247612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.248162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.248324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.248575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.248753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.259516] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 753.259701] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 753.259792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.260532] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: IN_PROGRESS for 2s [ 753.664601] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59198afd-c9ef-4be3-9692-377642c3e580 [ 753.664901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.665097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.665195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.665486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.665629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.665774] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59198afd-c9ef-4be3-9692-377642c3e580 already deleted. [ 753.665871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59198afd-c9ef-4be3-9692-377642c3e580" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.883585] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 in Status: SUCCESS [ 753.883846] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 deletion is rescheduled due to dependency. [ 753.884014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.060485] env[65319]: INFO networking_nsxv3.common.synchronization [req-64fb77ef-5a8e-4141-8e34-2765218e008a req-342414fe-5049-4039-8d55-1bc87b5f8e23 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: b5c128e1-838c-4867-8e6c-fd0d2f73849f with Priority: HIGHEST for action security_group_rules [ 754.061444] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5c128e1-838c-4867-8e6c-fd0d2f73849f with Priority: HIGHEST for action security_group_rules [ 754.061706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5c128e1-838c-4867-8e6c-fd0d2f73849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.061900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5c128e1-838c-4867-8e6c-fd0d2f73849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.061955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5c128e1-838c-4867-8e6c-fd0d2f73849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.064030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5c128e1-838c-4867-8e6c-fd0d2f73849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.064030] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5c128e1-838c-4867-8e6c-fd0d2f73849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.258817] env[65319]: INFO networking_nsxv3.common.synchronization [req-012675db-6f91-4110-9ee7-a63466f534d3 req-522bffb1-b201-4fc2-9e37-993a6b3412d8 tempest-ServersV294TestFqdnHostnames-85723109 tempest-ServersV294TestFqdnHostnames-85723109-project-member] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 754.259977] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 754.260827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.262090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.262090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.262370] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.585796] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.589080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.589080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.589080] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.593909] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.593909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.593909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.593909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.593909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.593909] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5c128e1-838c-4867-8e6c-fd0d2f73849f already deleted. [ 754.593909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5c128e1-838c-4867-8e6c-fd0d2f73849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.649012] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-884 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.649466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-884" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.649466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-884" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.649796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-884" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.649796] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.649995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.651078] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.651803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.651803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.651803] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.652132] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.652132] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.652132] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.652390] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.652465] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.652595] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.674188] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.674188] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.674417] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.675300] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-884" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.675300] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-0685369d-9012-4627-b344-11ede1d71934 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.675536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.675536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.675811] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.675955] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0685369d-9012-4627-b344-11ede1d71934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.764086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.764385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.764485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.764816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.764816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.765055] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.765131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.765197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.765345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.765421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.765510] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 already deleted. [ 754.765584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.033575] env[65319]: INFO networking_nsxv3.common.synchronization [None req-af10af79-149f-4ac7-abc0-12713a8531f2 tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 755.034604] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 755.035778] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.035778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.035778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.035778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.038675] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.094654] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.182019] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.182019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 0685369d-9012-4627-b344-11ede1d71934 not found, creating... [ 755.182019] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.182019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.182641] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.182641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.182641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.182641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.182641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.183489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 0685369d-9012-4627-b344-11ede1d71934 is going to be created. [ 755.205495] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.205669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.205747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.206096] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.206403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.207101] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.274510] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f60b841-0425-4faa-84ee-69be80917aa4 in Status: SUCCESS [ 755.274804] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 deletion is rescheduled due to dependency. [ 755.275012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.412650] env[65319]: INFO networking_nsxv3.common.synchronization [None req-18531a16-09d0-4b7c-b5cf-3fb99a01ee26 tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 755.412862] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 755.413399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.413568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.429039] env[65319]: INFO networking_nsxv3.common.synchronization [None req-1e8b9ce3-cbf6-4132-ba04-1e04be5db95c None None] Enqueued Resource ID: 7fe8ce79-4bbe-445e-859e-49787e429f8a with Priority: HIGHEST for action port [ 755.432177] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe8ce79-4bbe-445e-859e-49787e429f8a with Priority: HIGHEST for action port [ 755.432741] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fe8ce79-4bbe-445e-859e-49787e429f8a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.432928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fe8ce79-4bbe-445e-859e-49787e429f8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.433073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fe8ce79-4bbe-445e-859e-49787e429f8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.433425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fe8ce79-4bbe-445e-859e-49787e429f8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.433585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fe8ce79-4bbe-445e-859e-49787e429f8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.559399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.559649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.559756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.560269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.561032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.561032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 already deleted. [ 755.561032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.561032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.561405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.561405] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.599046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d9e57b-7b71-46dd-8bbf-e08a483c33e6: rpc.has_security_group_logging(os_id): False [ 755.620014] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.620014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.620014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.622376] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.622376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.624201] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be created. [ 755.691024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.691227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.691275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.691487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.691669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.704372] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: IN_PROGRESS for 2s [ 755.936389] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fe8ce79-4bbe-445e-859e-49787e429f8a [ 755.936672] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.936811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.936893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.937129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.937262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.937369] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fe8ce79-4bbe-445e-859e-49787e429f8a already deleted. [ 755.937493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fe8ce79-4bbe-445e-859e-49787e429f8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.947890] env[65319]: INFO networking_nsxv3.common.synchronization [req-012675db-6f91-4110-9ee7-a63466f534d3 req-371b2fee-c593-47f6-b5ca-7397ac69e54a service nova] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 755.948100] env[65319]: INFO networking_nsxv3.common.synchronization [req-012675db-6f91-4110-9ee7-a63466f534d3 req-371b2fee-c593-47f6-b5ca-7397ac69e54a service nova] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 755.948243] env[65319]: INFO networking_nsxv3.common.synchronization [req-012675db-6f91-4110-9ee7-a63466f534d3 req-371b2fee-c593-47f6-b5ca-7397ac69e54a service nova] Enqueued Resource ID: 0685369d-9012-4627-b344-11ede1d71934 with Priority: HIGHEST for action port [ 755.948871] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_rules [ 755.949171] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 755.949439] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0685369d-9012-4627-b344-11ede1d71934 with Priority: HIGHEST for action port [ 755.949720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.949841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.949908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.950150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.950260] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.951284] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.951661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.951759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.951998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.952265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.952396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.952473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.952646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.952732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.952823] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.953666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-0685369d-9012-4627-b344-11ede1d71934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.953800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.953872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.954146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.954240] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0685369d-9012-4627-b344-11ede1d71934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.085072] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.085072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.085072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.085072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.085072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.085072] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 already deleted. [ 756.085072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.456040] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.456345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.458784] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.460028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0685369d-9012-4627-b344-11ede1d71934 with status ACTIVE [ 756.460269] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.460429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.460500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.460732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.460787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.460989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.461111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.461203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.461392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.461515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.461710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.461806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.461885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.462804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.462932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.463050] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0685369d-9012-4627-b344-11ede1d71934 is going to be updated. [ 756.491295] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.491504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.491552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.491862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.492031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.492208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0685369d-9012-4627-b344-11ede1d71934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.622846] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 756.622846] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 756.622846] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 756.622846] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 756.622846] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.623835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.624273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.624795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.625524] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.625524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.625524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.625765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.625939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.626202] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.630063] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.630063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.630063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.630063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.630063] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.633623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.633623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.633623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.633623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.633623] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.677846] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_rules [ 756.678165] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 756.678344] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 756.678547] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 756.678748] env[65319]: INFO networking_nsxv3.common.synchronization [req-27963593-5e75-43ed-b2d3-e33c5a4cc961 req-0259844b-5c4f-405f-a089-f1c89081220b tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 756.679563] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_rules [ 756.679711] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 756.680107] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 756.680107] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 756.680107] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 756.680366] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.680513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.680593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.680915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.681041] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.682051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.682157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.682202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.682419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.682719] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.683926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dfc322e-e2e9-4f60-9309-5094655b3a08 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.684390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.684390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.684390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.684597] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfc322e-e2e9-4f60-9309-5094655b3a08',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.686471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.686471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.686471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.686471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.968040] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.973306] env[65319]: INFO networking_nsxv3.common.synchronization [req-51cc6740-a91a-4964-bc77-f118e34c5907 req-4ed72906-d82b-48d6-abc4-fa512b391c3b tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 756.974178] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 756.974540] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.974668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.974735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.975105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.975163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.975288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.975356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.975534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.975598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.975728] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.129256] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.138040] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.190021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.190210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.190480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.190581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.190787] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dfc322e-e2e9-4f60-9309-5094655b3a08 with status ACTIVE [ 757.190949] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.191082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.191150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.191362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.191449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.191642] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.191729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.191789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.191950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.192027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.192300] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.192429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.192476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.192608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.192732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.192783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 is going to be updated. [ 757.215380] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.215588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.215682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.215977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.216191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.216423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.379265] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.379506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.379615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.379917] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.380243] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.380442] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.380560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.380810] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.380960] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.381214] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.381333] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.381468] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.381576] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.382099] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.382099] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.382099] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.403156] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.403156] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.403156] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.403156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.403156] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-cff67af1-62b8-4501-b548-acc68b4f0b8a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.403156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.403156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.403156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.403156] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cff67af1-62b8-4501-b548-acc68b4f0b8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.474627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.477067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.477067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.477067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.477067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.477067] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 is going to be created. [ 757.483054] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.483054] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.483054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.483443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.483443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.483443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 already deleted. [ 757.483443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.504585] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.504666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.504699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.504904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.505080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.518776] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: UNINITIALIZED for 2s [ 757.631561] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.638349] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.726198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 757.726382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.905838] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.907400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.907400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.910027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.910027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.910027] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port cff67af1-62b8-4501-b548-acc68b4f0b8a not found, creating... [ 757.910027] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.910027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.910686] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.911213] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.911553] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.912155] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.913390] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.913390] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.913566] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.913869] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.913869] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: cff67af1-62b8-4501-b548-acc68b4f0b8a is going to be created. [ 757.942426] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.942725] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.942929] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.943349] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.943806] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.944063] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.136834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.137525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.137525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.137525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.137525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.137855] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be created. [ 758.140828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.140957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.141045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.141271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.141360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.141475] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 758.166660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.166847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.166953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.167310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.167516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.171545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.171734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.171837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.172112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.172299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.177838] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: UNINITIALIZED for 2s [ 758.183355] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 758.251047] env[65319]: INFO networking_nsxv3.common.synchronization [req-c60c5b12-6f94-4977-b6f8-7e419139c1e5 req-66392ba9-afeb-4a58-940e-00352d7206e6 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: ca1348be-5b62-46ca-bf7e-757b0d95e6ef with Priority: HIGHEST for action security_group_rules [ 758.251047] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1348be-5b62-46ca-bf7e-757b0d95e6ef with Priority: HIGHEST for action security_group_rules [ 758.251047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1348be-5b62-46ca-bf7e-757b0d95e6ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.251047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1348be-5b62-46ca-bf7e-757b0d95e6ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.251047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1348be-5b62-46ca-bf7e-757b0d95e6ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.251810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1348be-5b62-46ca-bf7e-757b0d95e6ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.252049] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1348be-5b62-46ca-bf7e-757b0d95e6ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.662917] env[65319]: INFO networking_nsxv3.common.synchronization [req-51cc6740-a91a-4964-bc77-f118e34c5907 req-03074f89-0efe-4e7d-8e85-12bb3c2ec137 service nova] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_rules [ 758.663196] env[65319]: INFO networking_nsxv3.common.synchronization [req-51cc6740-a91a-4964-bc77-f118e34c5907 req-03074f89-0efe-4e7d-8e85-12bb3c2ec137 service nova] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 758.663298] env[65319]: INFO networking_nsxv3.common.synchronization [req-51cc6740-a91a-4964-bc77-f118e34c5907 req-03074f89-0efe-4e7d-8e85-12bb3c2ec137 service nova] Enqueued Resource ID: cff67af1-62b8-4501-b548-acc68b4f0b8a with Priority: HIGHEST for action port [ 758.663760] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_rules [ 758.663895] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 758.663992] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff67af1-62b8-4501-b548-acc68b4f0b8a with Priority: HIGHEST for action port [ 758.664322] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.664451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.664505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.664779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.664838] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.666060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.666184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.666255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.666423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.666584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.666684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.666747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.666917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.667018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.668292] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.668695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cff67af1-62b8-4501-b548-acc68b4f0b8a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.668799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.668893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.669057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.669126] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cff67af1-62b8-4501-b548-acc68b4f0b8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.792029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.792029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.792029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.792029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.792029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.792293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1348be-5b62-46ca-bf7e-757b0d95e6ef already deleted. [ 758.792293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1348be-5b62-46ca-bf7e-757b0d95e6ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.171402] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.172085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.172085] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.172735] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cff67af1-62b8-4501-b548-acc68b4f0b8a with status ACTIVE [ 759.172923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.173047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.173111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.173350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.173460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.173617] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.173715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.173776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.173925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.174007] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.175327] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.175447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.176319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.176319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.176319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.176319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cff67af1-62b8-4501-b548-acc68b4f0b8a is going to be updated. [ 759.196114] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.196266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.196468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.196577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.196722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.196877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cff67af1-62b8-4501-b548-acc68b4f0b8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531982] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: SUCCESS [ 759.531982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.532309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532529] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.532755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.532755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.533323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.533323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.533323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.533323] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.593679] env[65319]: INFO networking_nsxv3.common.synchronization [req-bbbe95f7-f4d7-44ec-9467-232b39f7e60d req-50036ff3-176e-40bd-9009-9541e3527b35 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 759.594248] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 759.594545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.594725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.594725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.595025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.595410] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.595484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.595541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.595654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.595742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.595837] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.678212] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.911678] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.911902] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.911996] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.912375] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.912719] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.912890] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.913012] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.913242] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.913388] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.913587] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.913692] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.913819] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.913933] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.914089] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.914268] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.914548] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.934550] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.934707] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.934843] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.934999] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-781" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.935338] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-3728e0a9-ddb6-485b-adec-97936551f5ac taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.935505] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.935617] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.935940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.936089] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3728e0a9-ddb6-485b-adec-97936551f5ac',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.035554] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.102589] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.102589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.102790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.102833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.102934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.103263] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.103810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.103810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.103810] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be updated. [ 760.136505] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.136730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.136793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.137058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.137174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.148319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 760.182747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.182927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.182996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.183994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.184123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.184289] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be created. [ 760.190867] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 760.191115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.191322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.191550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.191739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.191865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.191942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.192198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.192198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.192339] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.202071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 760.202338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.202834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.203068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.203264] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.203383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.203710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.203885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.203982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.204100] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.214714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.214850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.214917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.215139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.215345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.226427] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: UNINITIALIZED for 2s [ 760.427021] env[65319]: INFO networking_nsxv3.common.synchronization [req-55f0dfed-eb74-4d07-844c-04a0af85f472 req-3bd4329b-2b2a-4100-be75-94f52e0727b5 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 760.427021] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 760.427021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d471d8da-f0c0-463e-992b-baccb28253af taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.427681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.427851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.428198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.428397] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d471d8da-f0c0-463e-992b-baccb28253af',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.439946] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.439946] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.439946] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.439946] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.440194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.440341] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 3728e0a9-ddb6-485b-adec-97936551f5ac not found, creating... [ 760.441168] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.441168] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.441168] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.441308] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.441413] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.441700] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.441845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.441952] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.442181] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.443032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.443032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 3728e0a9-ddb6-485b-adec-97936551f5ac is going to be created. [ 760.465928] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.466196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.466332] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.466714] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.466986] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.467263] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.539356] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78252624-98d5-4868-98b5-8ddc06e222b7: rpc.has_security_group_logging(os_id): False [ 760.562421] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.562641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.562641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.562864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.562958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.563213] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.563321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.563418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.564303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.564437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.564568] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 is going to be created. [ 760.650607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.650810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.650885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.651157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.651463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.667406] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: IN_PROGRESS for 2s [ 760.695877] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.708106] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.950930] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.951075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.951119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.953475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.953475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.953475] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d471d8da-f0c0-463e-992b-baccb28253af already deleted. [ 760.953475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.199020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.211559] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.280192] env[65319]: INFO networking_nsxv3.common.synchronization [req-bbbe95f7-f4d7-44ec-9467-232b39f7e60d req-b59d064d-3ef2-4f9c-beea-895ff2b25a42 service nova] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 761.280365] env[65319]: INFO networking_nsxv3.common.synchronization [req-bbbe95f7-f4d7-44ec-9467-232b39f7e60d req-b59d064d-3ef2-4f9c-beea-895ff2b25a42 service nova] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 761.280497] env[65319]: INFO networking_nsxv3.common.synchronization [req-bbbe95f7-f4d7-44ec-9467-232b39f7e60d req-b59d064d-3ef2-4f9c-beea-895ff2b25a42 service nova] Enqueued Resource ID: 3728e0a9-ddb6-485b-adec-97936551f5ac with Priority: HIGHEST for action port [ 761.280723] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_rules [ 761.280853] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 761.280948] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3728e0a9-ddb6-485b-adec-97936551f5ac with Priority: HIGHEST for action port [ 761.282409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.282409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.282409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.282409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.282409] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.283130] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.283225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.283428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-3728e0a9-ddb6-485b-adec-97936551f5ac taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.283525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.283642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.283764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.283840] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3728e0a9-ddb6-485b-adec-97936551f5ac',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.332719] env[65319]: INFO networking_nsxv3.common.synchronization [req-48a9259f-0f49-4cf6-9183-5fd44dc363ee req-35031d16-ab2a-4de6-97e8-ecd809292712 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 761.333739] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 761.334785] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d471d8da-f0c0-463e-992b-baccb28253af taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.334966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.335075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.340624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.340624] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d471d8da-f0c0-463e-992b-baccb28253af',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.701378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.701825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.701825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.701957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.702216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.702415] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be updated. [ 761.717539] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.717882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.717882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.718220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.718281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.718393] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 761.751022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.751304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.751548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.751872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.752266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.773466] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 761.786050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.786050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.793333] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3728e0a9-ddb6-485b-adec-97936551f5ac with status ACTIVE [ 761.793333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.793333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.793333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.793333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.793333] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3728e0a9-ddb6-485b-adec-97936551f5ac is going to be updated. [ 761.795504] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.795836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.795995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.796281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.796522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.805650] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 761.826492] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.826674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.826746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.826982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.827156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.827827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3728e0a9-ddb6-485b-adec-97936551f5ac" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.874026] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.874026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.874026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.874026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.874026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.874026] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d471d8da-f0c0-463e-992b-baccb28253af already deleted. [ 761.874026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.161036] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 762.161266] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 deletion is rescheduled due to dependency. [ 762.161423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.161704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.162430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.162430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.162600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.162703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.162929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.163080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163192] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.236887] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 762.237039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.238731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.238835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.239120] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.239316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.239361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.243968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.243968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.243968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.243968] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.424784] env[65319]: INFO networking_nsxv3.common.synchronization [req-03fa6a19-d249-4436-babc-7d288164205f req-c22ec716-e868-4a2b-96f9-828981308bc4 tempest-SecurityGroupRulesTestJSON-872593671 tempest-SecurityGroupRulesTestJSON-872593671-project-member] Enqueued Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 762.426034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d471d8da-f0c0-463e-992b-baccb28253af with Priority: HIGHEST for action security_group_rules [ 762.426483] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d471d8da-f0c0-463e-992b-baccb28253af taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.426586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.426586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.426795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.426879] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d471d8da-f0c0-463e-992b-baccb28253af',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.666094] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.687517] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: SUCCESS [ 762.687819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.747331] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.747753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.747753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.747984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.748150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.748262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.748346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.748509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.748638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.748735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.748892] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.749141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.749221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.749470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.749577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.749688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.749739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.749889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.749939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.750068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.750126] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.950354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.951188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.951436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.954717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.955027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.955235] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d471d8da-f0c0-463e-992b-baccb28253af already deleted. [ 762.955452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d471d8da-f0c0-463e-992b-baccb28253af" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.171876] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.252612] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7: rpc.has_security_group_logging(os_id): False [ 763.274352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.274352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.274352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.274352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.274809] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.274809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.275054] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be created. [ 763.335053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.335208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.335261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.337428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.337428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.350261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: IN_PROGRESS for 2s [ 763.676116] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.676283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.676345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.676560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.676672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.676773] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be updated. [ 763.709681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.709681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.709681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.709681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.709681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.717196] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 763.784055] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 763.784055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.784658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.784658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.784658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.784863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.784905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.785137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.785259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.785382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.785514] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.799018] env[65319]: INFO networking_nsxv3.common.synchronization [req-2340c456-193f-4cc2-9258-f122dee4acfc req-be351fa1-1fd6-44d4-9d34-7276d10ff49f tempest-ServersNegativeTestMultiTenantJSON-623965024 tempest-ServersNegativeTestMultiTenantJSON-623965024-project-member] Enqueued Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 763.799639] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 with Priority: HIGHEST for action security_group_members [ 763.800359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.800359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.800359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.800359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.800662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.800662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.800662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.800826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.800871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.801222] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1c365c2-b0da-43cf-8088-9c38fa4c5ec9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.819404] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.819404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.819404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.819404] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.288469] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.302746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.303616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.303616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.303616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.303616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.303907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.303907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.303907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.304060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.304060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.304167] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 is going to be updated. [ 764.320555] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.320772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.320915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.321218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.321346] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.322429] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.322429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.323229] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.323229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.323229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.323229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.323229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.323229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.323229] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.339051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.339204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.339276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.339488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.339624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.348749] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: IN_PROGRESS for 2s [ 764.793894] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c: rpc.has_security_group_logging(os_id): False [ 764.814204] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.814204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.814204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.814204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.814204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.815558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.815708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.815947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.816201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.816293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.816399] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be created. [ 764.826615] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 764.850336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.850336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.850336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.850571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.850571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.850816] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.850913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.850974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.851145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.852072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.852072] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.852072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.852072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.852072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.852072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.852072] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.852621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.852769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.852992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.853135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.853280] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 764.905334] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.905334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.905334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.905334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.905334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.917969] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 764.920184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.920372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.920437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.920617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.922100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.937596] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 765.369798] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 765.369798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.729250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 765.729606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.729751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730270] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.730467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.730467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730909] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.235161] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.360777] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 in Status: SUCCESS [ 766.360909] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1c365c2-b0da-43cf-8088-9c38fa4c5ec9 deletion is rescheduled due to dependency. [ 766.360989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1c365c2-b0da-43cf-8088-9c38fa4c5ec9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.739092] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0: rpc.has_security_group_logging(os_id): False [ 766.765767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.765974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.765974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.766365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.766505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.766873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.766981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.767070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.767369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.767457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.767544] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be updated. [ 766.886720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.886988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.886988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.887566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.887566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.911608] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 766.937904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 766.938836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.968982] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 766.969285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.333829] env[65319]: INFO networking_nsxv3.common.synchronization [req-06cc2ebe-0e7e-4fb0-88c0-cd6c3216bc57 req-4f46e9ef-ebb1-4c8e-9d7c-0a71bce62ea6 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 767.333829] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 767.333829] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.333829] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.333829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.333829] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.637482] env[65319]: INFO networking_nsxv3.common.synchronization [None req-1b0b6666-0683-4744-b5cf-80c75748785c None None] Enqueued Resource ID: 874ede9a-39b6-49f9-abe8-fa9b09589f63 with Priority: HIGHEST for action port [ 767.637739] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 874ede9a-39b6-49f9-abe8-fa9b09589f63 with Priority: HIGHEST for action port [ 767.638339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-874ede9a-39b6-49f9-abe8-fa9b09589f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.638505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-874ede9a-39b6-49f9-abe8-fa9b09589f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.638562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-874ede9a-39b6-49f9-abe8-fa9b09589f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.638796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-874ede9a-39b6-49f9-abe8-fa9b09589f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.638852] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('874ede9a-39b6-49f9-abe8-fa9b09589f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.835099] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.835342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.835421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.835649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.835743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.835962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.836115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.836177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.836338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.836407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.836501] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 767.887442] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.888267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.888267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.888267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.888267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.899556] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 768.142104] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 874ede9a-39b6-49f9-abe8-fa9b09589f63 [ 768.142367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.142544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.142617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.142838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.142932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.143066] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:874ede9a-39b6-49f9-abe8-fa9b09589f63 already deleted. [ 768.143168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-874ede9a-39b6-49f9-abe8-fa9b09589f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.167946] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.168216] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.168295] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.168604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.168913] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.169089] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.169206] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.169456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.169555] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.169770] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.169885] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.170017] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.170147] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.170263] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.170407] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.170496] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.192989] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.193169] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.193322] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.193528] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.193898] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-24d6cb61-c368-4770-83ef-8171dc1e8339 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.194072] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.194283] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.194625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.194769] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24d6cb61-c368-4770-83ef-8171dc1e8339',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.697705] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.698194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.698194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.698435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.699290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.699290] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 24d6cb61-c368-4770-83ef-8171dc1e8339 not found, creating... [ 768.699290] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.699290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.699290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.699658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.699658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.701189] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.701189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.701189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.702025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.702025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.702300] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 24d6cb61-c368-4770-83ef-8171dc1e8339 is going to be created. [ 768.731189] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.731541] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.731748] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.732150] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.732506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.732867] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.935606] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 768.935606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.422022] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 769.422233] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 769.422361] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 769.422874] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 769.423226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 769.423226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 769.423685] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe87a22-3adb-428a-a7f9-6ac041b0b546 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.423849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.423939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.424282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.424489] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.424635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.424798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.425026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.425158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.425315] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.426236] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.428223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.428308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.429061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.429423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.429423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.429423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.429600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.429600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.429697] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.432032] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.432032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.432032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.432032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.432032] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.432032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.432032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.433905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.434046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.434157] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.469323] env[65319]: INFO networking_nsxv3.common.synchronization [req-06cc2ebe-0e7e-4fb0-88c0-cd6c3216bc57 req-b7324109-b8d8-44c1-b9a7-e6286c1b0d1f service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 769.469699] env[65319]: INFO networking_nsxv3.common.synchronization [req-06cc2ebe-0e7e-4fb0-88c0-cd6c3216bc57 req-b7324109-b8d8-44c1-b9a7-e6286c1b0d1f service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 769.469699] env[65319]: INFO networking_nsxv3.common.synchronization [req-06cc2ebe-0e7e-4fb0-88c0-cd6c3216bc57 req-b7324109-b8d8-44c1-b9a7-e6286c1b0d1f service nova] Enqueued Resource ID: 24d6cb61-c368-4770-83ef-8171dc1e8339 with Priority: HIGHEST for action port [ 769.469855] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 769.469977] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 769.470082] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24d6cb61-c368-4770-83ef-8171dc1e8339 with Priority: HIGHEST for action port [ 769.470666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.470759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.470813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.472016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.472016] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.472412] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.472558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.472836] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-24d6cb61-c368-4770-83ef-8171dc1e8339 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.472992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.473111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.473404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.473581] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24d6cb61-c368-4770-83ef-8171dc1e8339',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.486844] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_rules [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_rules [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 769.488193] env[65319]: INFO networking_nsxv3.common.synchronization [req-401004e4-94fd-4cc8-817d-6cfdb85fd657 req-67073e29-cf7b-409f-9acd-8a57922ba9c9 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 769.488687] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_rules [ 769.488831] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_rules [ 769.488927] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 769.489027] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 with Priority: HIGHEST for action port [ 769.489140] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_rules [ 769.489336] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 769.489336] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 769.489595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.489716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.489780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.489967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.490071] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.491221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe87a22-3adb-428a-a7f9-6ac041b0b546 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.491367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.491453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.491689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.491792] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.493096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.493096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.493096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dfc322e-e2e9-4f60-9309-5094655b3a08 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.493096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.493096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.493337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.493337] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfc322e-e2e9-4f60-9309-5094655b3a08',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.494377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.494460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.494544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.494740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.494837] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.496471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.496471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.496471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe87a22-3adb-428a-a7f9-6ac041b0b546 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.496471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.911434] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 769.911736] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 769.911736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.911988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.912109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.912323] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.912944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.912944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.912944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.912944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.912944] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.935583] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.936636] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.940993] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.976746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.976746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.976746] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24d6cb61-c368-4770-83ef-8171dc1e8339 with status ACTIVE [ 769.976746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.976746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.976746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.978491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.978491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.978491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.978948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.978948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.978948] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24d6cb61-c368-4770-83ef-8171dc1e8339 is going to be updated. [ 770.000452] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dfc322e-e2e9-4f60-9309-5094655b3a08 with status ACTIVE [ 770.002169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.002398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.002506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.002771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.002878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.003150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.003259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.003319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.003590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.003590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.003783] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.003872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.003930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.004081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.004149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.004286] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dfc322e-e2e9-4f60-9309-5094655b3a08 is going to be updated. [ 770.005659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe87a22-3adb-428a-a7f9-6ac041b0b546 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.005792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.006101] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.006224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.007459] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.007620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.007714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.007947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.008146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.008307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24d6cb61-c368-4770-83ef-8171dc1e8339" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.008876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.008965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.037831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.037997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.038117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.038337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.038422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.038584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dfc322e-e2e9-4f60-9309-5094655b3a08" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.417180] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.439676] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.440710] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.444036] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.700259] env[65319]: INFO networking_nsxv3.common.synchronization [None req-71705478-a627-4d89-a4e7-39cc4e6292d0 None None] Enqueued Resource ID: 6475b2fb-ca14-4d82-ab19-d39f6556813e with Priority: HIGHEST for action port [ 770.700787] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6475b2fb-ca14-4d82-ab19-d39f6556813e with Priority: HIGHEST for action port [ 770.701134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-6475b2fb-ca14-4d82-ab19-d39f6556813e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.701215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6475b2fb-ca14-4d82-ab19-d39f6556813e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.701277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6475b2fb-ca14-4d82-ab19-d39f6556813e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.701537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6475b2fb-ca14-4d82-ab19-d39f6556813e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.701620] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6475b2fb-ca14-4d82-ab19-d39f6556813e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.812621] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 770.812744] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:1 started [ 770.921760] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.941366] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.941882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.942062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.942558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.942735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.942910] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 is going to be created. [ 770.944836] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.944982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.945058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.945327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.945415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.945521] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be updated. [ 770.946931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.947068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.947138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.947313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.947393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.947476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 770.983536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.983536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.983536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.983536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.983536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.985053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.985342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.985465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.985741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.985933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.987720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.987934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.988078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.988314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.988522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.001358] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 771.002422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 in Status: UNINITIALIZED for 2s [ 771.003228] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 771.203543] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6475b2fb-ca14-4d82-ab19-d39f6556813e [ 771.204119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.204450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.204671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.204920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.205031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.205137] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6475b2fb-ca14-4d82-ab19-d39f6556813e already deleted. [ 771.205253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6475b2fb-ca14-4d82-ab19-d39f6556813e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.429877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.429877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.429877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.429877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.430095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.430298] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 771.464937] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.465045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.465045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.465358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.465452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.475054] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 771.657542] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5889d2ce-5fc8-40aa-89f0-9ea9f6bff241 None None] Enqueued Resource ID: 7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc with Priority: HIGHEST for action port [ 771.659018] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc with Priority: HIGHEST for action port [ 771.659018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.659018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.659018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.663021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.663021] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.164278] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc [ 772.164676] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.164818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.164860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.165234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.165294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.165387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc already deleted. [ 772.165470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d4d7c3e-99fd-4438-8d2e-b1044e75c7fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.891995] env[65319]: INFO networking_nsxv3.common.synchronization [req-33ef1552-38ed-4aca-a9bd-887a500f0a21 req-2a15c2f2-d308-4b2d-bfc0-82c54d58528e tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 772.891995] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 772.891995] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.891995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.891995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.894503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.894503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.894503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.894503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.894503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.894503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.894503] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.016425] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 773.019376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.019376] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 in Status: SUCCESS [ 773.019376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.019743] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 773.019930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.020136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.020423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.020717] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.020783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.020817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.020966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.021090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.021201] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.022053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.022261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.022448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.022578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.022764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.023700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.023885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.024019] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.025216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.025896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.025896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.025896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.025896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.025896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.026128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.026128] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.397682] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.457384] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.458395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.458395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.458395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.458901] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.458901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.459294] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.459628] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.459850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.460323] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.460513] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.461202] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.461202] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.461202] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.461712] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.461712] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.492703] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.492703] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.492863] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.493229] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.493811] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-8f200d3e-4347-4efe-97ee-471eece64b8e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.494168] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.494314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.494871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.494871] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f200d3e-4347-4efe-97ee-471eece64b8e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.498670] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 773.498670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.498670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.498794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.498939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.499073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.499141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.499312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.499395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.529778] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.530964] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.532246] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.901058] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.002418] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.002675] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.002797] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.003083] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.003247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.003407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 8f200d3e-4347-4efe-97ee-471eece64b8e not found, creating... [ 774.003685] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.003844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.003956] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.004506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.004600] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.004916] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.005147] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.005324] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.005764] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.005764] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.005898] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 8f200d3e-4347-4efe-97ee-471eece64b8e is going to be created. [ 774.007161] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.007288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.007352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.007513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.007665] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.007772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.007839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.007967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.008057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.008140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.008397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.008762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.008762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.009108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.009108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.009182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.009567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.009567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.009567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.009567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.009706] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.033468] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.033688] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.033809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.034094] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.034352] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.034575] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.035393] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.036413] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.038967] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.406395] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.406762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.406762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.406851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.406915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.407020] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 774.443932] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.443932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.443932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.443932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.443932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.453191] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 774.513234] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 774.533886] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.534124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.534124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.534414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.534549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.535640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.535640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.535640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.535640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.535640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.535640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.535640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.536022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.536022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.536022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.536631] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.537270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.537660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.538327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.538975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.542252] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 774.543813] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.544175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.544175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.544351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.544527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.544588] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 774.548376] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.548376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.548376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.548376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.548376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.548376] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 is going to be updated. [ 774.548691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.549428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.549428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.549428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.549428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.549573] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be updated. [ 774.593677] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.593677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.593677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.593677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.593677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.595907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.595907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.596127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.596193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.596327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.599334] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.599492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.599567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.599765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.601743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.612060] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 774.612811] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 774.613404] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 in Status: IN_PROGRESS for 2s [ 774.648379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.648379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.648379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.648664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.648664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.668163] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 774.705586] env[65319]: INFO networking_nsxv3.common.synchronization [None req-906d7e4c-67b9-4e66-b4c8-67b5d85e9470 None None] Enqueued Resource ID: 75f3121d-7824-4b48-b3fe-912681f166bf with Priority: HIGHEST for action port [ 774.706126] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f3121d-7824-4b48-b3fe-912681f166bf with Priority: HIGHEST for action port [ 774.706430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-75f3121d-7824-4b48-b3fe-912681f166bf taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.707104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75f3121d-7824-4b48-b3fe-912681f166bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.707247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75f3121d-7824-4b48-b3fe-912681f166bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.708138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75f3121d-7824-4b48-b3fe-912681f166bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.708138] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75f3121d-7824-4b48-b3fe-912681f166bf',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.769179] env[65319]: INFO networking_nsxv3.common.synchronization [req-33ef1552-38ed-4aca-a9bd-887a500f0a21 req-cfd7eff7-9eca-49eb-86e8-ec1b6ad17437 service nova] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_rules [ 774.769351] env[65319]: INFO networking_nsxv3.common.synchronization [req-33ef1552-38ed-4aca-a9bd-887a500f0a21 req-cfd7eff7-9eca-49eb-86e8-ec1b6ad17437 service nova] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 774.769482] env[65319]: INFO networking_nsxv3.common.synchronization [req-33ef1552-38ed-4aca-a9bd-887a500f0a21 req-cfd7eff7-9eca-49eb-86e8-ec1b6ad17437 service nova] Enqueued Resource ID: 8f200d3e-4347-4efe-97ee-471eece64b8e with Priority: HIGHEST for action port [ 774.770034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_rules [ 774.770159] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 774.770260] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f200d3e-4347-4efe-97ee-471eece64b8e with Priority: HIGHEST for action port [ 774.770537] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.770699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.770770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.770948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.771240] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.772547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.772963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.773280] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f200d3e-4347-4efe-97ee-471eece64b8e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.773400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.773507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.773719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.773804] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f200d3e-4347-4efe-97ee-471eece64b8e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.086688] env[65319]: INFO networking_nsxv3.common.synchronization [req-b73daf05-c407-4812-bbf7-1e5ae43384b9 req-1bf3e51f-25dd-4e27-83fd-1c90f7202532 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 775.086988] env[65319]: INFO networking_nsxv3.common.synchronization [req-b73daf05-c407-4812-bbf7-1e5ae43384b9 req-1bf3e51f-25dd-4e27-83fd-1c90f7202532 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 775.087240] env[65319]: INFO networking_nsxv3.common.synchronization [req-b73daf05-c407-4812-bbf7-1e5ae43384b9 req-1bf3e51f-25dd-4e27-83fd-1c90f7202532 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 775.087847] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 with Priority: HIGHEST for action security_group_members [ 775.088071] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGHEST for action security_group_members [ 775.088256] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 775.088619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe87a22-3adb-428a-a7f9-6ac041b0b546 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.088797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.089095] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.089375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.090164] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.090164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.211259] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75f3121d-7824-4b48-b3fe-912681f166bf [ 775.211850] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.212941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.212941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.212941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.212941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.212941] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75f3121d-7824-4b48-b3fe-912681f166bf already deleted. [ 775.212941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75f3121d-7824-4b48-b3fe-912681f166bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.273640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.273794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.276194] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f200d3e-4347-4efe-97ee-471eece64b8e with status ACTIVE [ 775.276399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.276511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.276592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.276791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.276881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.277168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.277168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.277413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.277413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.277488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.277605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.277696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.277751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.278353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.278353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.278353] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f200d3e-4347-4efe-97ee-471eece64b8e is going to be updated. [ 775.303610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.303905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.303905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.304120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.304279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.304553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f200d3e-4347-4efe-97ee-471eece64b8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.868048] env[65319]: INFO networking_nsxv3.common.synchronization [req-20717001-1bf0-4eb9-8b62-cf6f33853a6e req-a7b1d358-4d83-458c-9bb8-a01f73329330 tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 775.868643] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 775.868946] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.869197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.869297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.870491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.870491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.870652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.870652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.870930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.870930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.871189] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.330126] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.330450] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.330704] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.331080] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.332030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.332030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.332030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.332513] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.332551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.333461] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.333461] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.333461] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.333461] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.333630] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.333775] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.333912] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.336857] env[65319]: INFO networking_nsxv3.common.synchronization [None req-66cc6f21-b621-4867-8aff-848ccf6faa07 None None] Enqueued Resource ID: bff30711-a66e-4b66-b3fb-0e52f0ec4947 with Priority: HIGHEST for action port [ 776.337876] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff30711-a66e-4b66-b3fb-0e52f0ec4947 with Priority: HIGHEST for action port [ 776.338554] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff30711-a66e-4b66-b3fb-0e52f0ec4947 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.339512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff30711-a66e-4b66-b3fb-0e52f0ec4947" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.339512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff30711-a66e-4b66-b3fb-0e52f0ec4947" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.339512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff30711-a66e-4b66-b3fb-0e52f0ec4947" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.339512] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff30711-a66e-4b66-b3fb-0e52f0ec4947',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.356357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.356567] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.356714] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.356905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.357282] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-a9175efe-d201-4d09-9485-5240d95c126b taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.357548] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.357727] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.358147] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.358298] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9175efe-d201-4d09-9485-5240d95c126b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.373535] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.373535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.373535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.373767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.373767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.373910] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.373988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.374071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.374266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.374341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.374460] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 776.401554] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.401766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.401812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.402814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.402814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.411704] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 776.463639] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 776.463903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.464109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.464369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.464594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.464756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.464828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.464994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.465094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.465191] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.629028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 776.629028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.629028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 in Status: SUCCESS [ 776.629028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.629801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 776.630168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.630478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.630873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.631235] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.631552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.633026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.633026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.633026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.633026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.633026] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.633843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.635017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.635017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.635017] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.636951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.636951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.636951] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.636951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.636951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.637377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.637377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.637510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.637739] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.638849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.639142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.639361] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.639619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.639742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.639932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.640132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.640261] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.641311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.641680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.641882] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.642055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.642153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.642382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.642519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.642636] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.643598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.643898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.644180] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.644352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.644443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.644581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.644663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.644747] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.683186] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 776.683186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.841786] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bff30711-a66e-4b66-b3fb-0e52f0ec4947 [ 776.841786] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.841786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.841984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.845012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.845012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.845012] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bff30711-a66e-4b66-b3fb-0e52f0ec4947 already deleted. [ 776.845012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff30711-a66e-4b66-b3fb-0e52f0ec4947" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.864025] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.864025] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port a9175efe-d201-4d09-9485-5240d95c126b not found, creating... [ 776.864025] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.864025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.864586] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.864586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.864586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.864586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.865119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865419] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: a9175efe-d201-4d09-9485-5240d95c126b is going to be created. [ 776.893181] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.893617] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.893617] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.893791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.894054] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.894356] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.967044] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.139586] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.140719] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe87a22-3adb-428a-a7f9-6ac041b0b546',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.146133] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.146283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.146594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.146737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.146815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.147155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.147199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.147378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.147499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.147608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.147780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.147892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.147988] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be updated. [ 777.149354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.149466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.149466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.149614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.149724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.149916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.150047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.150118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.150284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.150381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.150477] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 is going to be deleted. [ 777.151542] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.180296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.180500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.180721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.180810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.180966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.188429] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.188586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.188669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.188899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.189028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.189127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.191177] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 777.471017] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.644600] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c: rpc.has_security_group_logging(os_id): False [ 777.644600] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe87a22-3adb-428a-a7f9-6ac041b0b546: rpc.has_security_group_logging(os_id): False [ 777.656556] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.662085] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.664303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.664513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.664816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.665084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.665547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.665966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.666162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.666420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.666580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.666740] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be updated. [ 777.669224] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.669525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.669681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.669927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.671020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.671020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.671020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.671020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.671020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.671020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.671020] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 is going to be created. [ 777.694174] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546], does not exist path=[/infra/domains/default/groups/3fe87a22-3adb-428a-a7f9-6ac041b0b546]."\n}' [ 777.694174] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546 [ 777.694174] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 777.704192] env[65319]: INFO networking_nsxv3.common.synchronization [req-20717001-1bf0-4eb9-8b62-cf6f33853a6e req-27e30e2c-bfda-4738-ba34-5cf76a606ee9 service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 777.704453] env[65319]: INFO networking_nsxv3.common.synchronization [req-20717001-1bf0-4eb9-8b62-cf6f33853a6e req-27e30e2c-bfda-4738-ba34-5cf76a606ee9 service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 777.704590] env[65319]: INFO networking_nsxv3.common.synchronization [req-20717001-1bf0-4eb9-8b62-cf6f33853a6e req-27e30e2c-bfda-4738-ba34-5cf76a606ee9 service nova] Enqueued Resource ID: a9175efe-d201-4d09-9485-5240d95c126b with Priority: HIGHEST for action port [ 777.707031] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 777.707105] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 777.707541] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9175efe-d201-4d09-9485-5240d95c126b with Priority: HIGHEST for action port [ 777.708310] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.709317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.709317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.709317] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.710083] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.710251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.710448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9175efe-d201-4d09-9485-5240d95c126b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.710585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.710652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.710842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.710914] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9175efe-d201-4d09-9485-5240d95c126b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.739146] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.739146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.739146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.739146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.747691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.747691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.747691] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe87a22-3adb-428a-a7f9-6ac041b0b546 is going to be created. [ 777.747691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.747691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.748310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.748310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.763864] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: IN_PROGRESS for 2s [ 777.767251] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546], does not exist path=[/infra/domains/default/groups/3fe87a22-3adb-428a-a7f9-6ac041b0b546]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546 [ 777.767391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe87a22-3adb-428a-a7f9-6ac041b0b546" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.767917] env[65319]: Traceback (most recent call last): [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 777.767998] env[65319]: return func(*args, **kwargs) [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.767998] env[65319]: res.raise_for_status() [ 777.767998] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.767998] env[65319]: raise HTTPError(http_error_msg, response=self) [ 777.767998] env[65319]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546 [ 777.767998] env[65319]: During handling of the above exception, another exception occurred: [ 777.767998] env[65319]: Traceback (most recent call last): [ 777.767998] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 777.767998] env[65319]: listener.cb(fileno) [ 777.767998] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 777.767998] env[65319]: result = function(*args, **kwargs) [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 777.767998] env[65319]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 777.767998] env[65319]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 777.767998] env[65319]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 777.767998] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 777.767998] env[65319]: res.raise_for_status() [ 777.767998] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 777.767998] env[65319]: raise HTTPError(http_error_msg, response=self) [ 777.767998] env[65319]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3fe87a22-3adb-428a-a7f9-6ac041b0b546 [ 777.767998] env[65319]: Removing descriptor: 13 [ 777.976247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.976247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.976247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.976784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.976784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.976784] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 778.011456] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.011456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.011456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.012502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.012502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.024904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 778.162400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.162502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.163188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.163188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.163188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.163372] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 778.200725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.200910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.200983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.201232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.201398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.213394] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 778.214049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.214207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.214808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9175efe-d201-4d09-9485-5240d95c126b with status ACTIVE [ 778.215286] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.215434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.215502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.215883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.216081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.216189] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.216546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.216604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.216754] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.217063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.217138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.217244] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9175efe-d201-4d09-9485-5240d95c126b is going to be updated. [ 778.264635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.264635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.264635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.264635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.264635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.264635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9175efe-d201-4d09-9485-5240d95c126b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.427184] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 778.427377] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 deletion is rescheduled due to dependency. [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.431020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.431020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.431020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.493836] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d7776600-cfa7-43eb-ae1d-e1c3f267b790 tempest-ServersTestJSON-514632879 tempest-ServersTestJSON-514632879-project-member] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 778.493836] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 778.493836] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.494044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.494044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.494578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.494663] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.629583] env[65319]: INFO networking_nsxv3.common.synchronization [None req-891f8d20-dba8-49bc-a2d4-6d7f716e5978 tempest-ServersTestJSON-514632879 tempest-ServersTestJSON-514632879-project-member] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 778.630154] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 778.630458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.630969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.857226] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5c5b853c-3e7c-472e-96e4-56c1e98f7bb3 None None] Enqueued Resource ID: c6b60e4c-a324-4cf9-b563-1d84b5381901 with Priority: HIGHEST for action port [ 778.858612] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b60e4c-a324-4cf9-b563-1d84b5381901 with Priority: HIGHEST for action port [ 778.858612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b60e4c-a324-4cf9-b563-1d84b5381901 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.858612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b60e4c-a324-4cf9-b563-1d84b5381901" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.858612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b60e4c-a324-4cf9-b563-1d84b5381901" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.858612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b60e4c-a324-4cf9-b563-1d84b5381901" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.858892] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b60e4c-a324-4cf9-b563-1d84b5381901',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.931945] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.017484] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.017772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.017772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.018227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.018227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.018227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad already deleted. [ 779.018227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.019486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.019697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.019785] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.202494] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 779.202685] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c deletion is rescheduled due to dependency. [ 779.202817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.363504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6b60e4c-a324-4cf9-b563-1d84b5381901 [ 779.363504] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.363504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.363504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.363504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.363504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.363504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6b60e4c-a324-4cf9-b563-1d84b5381901 already deleted. [ 779.364409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b60e4c-a324-4cf9-b563-1d84b5381901" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.435555] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.545818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.546152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.546152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.546252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.546347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.546470] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad already deleted. [ 779.546612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.778782] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c in Status: SUCCESS [ 779.779043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.937719] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.938018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.938018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.938343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.938419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.938544] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 779.969691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.969691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.969691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.969691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.969691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.978334] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 780.036032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 780.036032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.036413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.037579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.037579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.037579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.037579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.037579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.037579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.038060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.038060] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.230845] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 780.232255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.232255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.232255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.232255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.232255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.232255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.232566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.232566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.232629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.233280] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.233280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.233280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.234123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.234123] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.234123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.234123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.234123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.234123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.234371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.234371] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.541708] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.541881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.541930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.542229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.542329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.542427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.542487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.542631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.542709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.542920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.543218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.543313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.543371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.543523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.543737] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.543737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.543853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.544941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.544941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.544941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.544941] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.737265] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 746f1312-5d40-4fc8-b702-cb8a17f5faa8: rpc.has_security_group_logging(os_id): False [ 780.756412] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.756608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.756692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.756890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.778093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.778396] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.779020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.779020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.779020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.779020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.779297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.779297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.779297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.779479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.779530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.779706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.779828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.779889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.780370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.780370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.780370] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 780.861918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.862135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.862235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.862511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.862719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.891301] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 781.046235] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffe73d27-cd4d-4ef2-a753-b8b05d2db48d: rpc.has_security_group_logging(os_id): False [ 781.065758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.065917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.065990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.066216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.088609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.088881] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.089026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.089159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.089312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.089395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.089695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.089861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.089922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.090183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.090307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.090402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.090471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.090677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.090765] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 781.188608] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.188752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.189587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.189879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.190067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.215644] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 781.993489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 781.993745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.993947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.994306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.994535] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.994675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.994739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.994922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.995018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.996579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.996695] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.498610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.498909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.498909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.499144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.499358] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.499452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.499529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.499663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.499754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.499904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.500129] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.500242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.500508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.500508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.501300] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.501300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.501300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.501300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.501300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.501300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.501535] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.912667] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 782.912907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.003998] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6058afe7-0c04-438a-8ff7-fa0b65021981: rpc.has_security_group_logging(os_id): False [ 783.035762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.035762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.035762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.035762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.181149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.181202] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.181601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.183416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.183566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.183634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.183947] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.184112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.184249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.184953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.185178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.185544] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.185745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.185868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.186135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.186289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.186438] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 783.230966] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 783.231243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.278282] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.278434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.278509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.278876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.279052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.294609] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 783.858657] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 783.858926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 785.315724] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 785.316711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.401870] env[65319]: INFO networking_nsxv3.common.synchronization [req-5815bf69-f1cd-4e55-a0ec-7d31ae082978 req-b83c444e-fed4-4b75-8d62-75ec75b42ac0 tempest-ListImageFiltersTestJSON-1347272766 tempest-ListImageFiltersTestJSON-1347272766-project-member] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 785.402992] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 785.403362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.403362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.403621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.403883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.404184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.404379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.404476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.404855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.404989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.405136] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.845866] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.846000] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.846132] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.846492] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.846625] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.846772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.846881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.847222] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.847403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.847580] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.847692] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.847797] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.847895] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.848440] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.848440] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.848440] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.867994] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.868177] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.868302] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.868468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.868770] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-bb05091a-31fe-42f3-9fa7-22e070e414fa taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.869100] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.869245] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.869589] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.870624] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb05091a-31fe-42f3-9fa7-22e070e414fa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.908730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.908862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.908908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.909771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.909771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.909771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.909771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.909771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.909986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.909986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.909986] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e already deleted. [ 785.910092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.152692] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d248b480-ad1f-40bb-bd6d-4addea58682c None None] Enqueued Resource ID: da637cff-8818-44d8-8cab-d124e5c133fc with Priority: HIGHEST for action port [ 786.153339] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da637cff-8818-44d8-8cab-d124e5c133fc with Priority: HIGHEST for action port [ 786.154043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-da637cff-8818-44d8-8cab-d124e5c133fc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.154043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da637cff-8818-44d8-8cab-d124e5c133fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.154043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da637cff-8818-44d8-8cab-d124e5c133fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.154330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da637cff-8818-44d8-8cab-d124e5c133fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.154398] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da637cff-8818-44d8-8cab-d124e5c133fc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.373264] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.373647] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.373647] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.374217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.374217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.374399] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port bb05091a-31fe-42f3-9fa7-22e070e414fa not found, creating... [ 786.374580] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.374763] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.374849] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.375084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.375224] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.375516] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.375893] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.375893] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.376114] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.376252] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.376392] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: bb05091a-31fe-42f3-9fa7-22e070e414fa is going to be created. [ 786.397409] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.397626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.397718] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.397972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.398221] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.398643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.656825] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da637cff-8818-44d8-8cab-d124e5c133fc [ 786.657109] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.657313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.657438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.657705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.657762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.657894] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da637cff-8818-44d8-8cab-d124e5c133fc already deleted. [ 786.658027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da637cff-8818-44d8-8cab-d124e5c133fc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.157089] env[65319]: INFO networking_nsxv3.common.synchronization [req-5815bf69-f1cd-4e55-a0ec-7d31ae082978 req-e4b7320a-5fbe-4186-b654-0969cbb19aa6 service nova] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_rules [ 787.157089] env[65319]: INFO networking_nsxv3.common.synchronization [req-5815bf69-f1cd-4e55-a0ec-7d31ae082978 req-e4b7320a-5fbe-4186-b654-0969cbb19aa6 service nova] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 787.157089] env[65319]: INFO networking_nsxv3.common.synchronization [req-5815bf69-f1cd-4e55-a0ec-7d31ae082978 req-e4b7320a-5fbe-4186-b654-0969cbb19aa6 service nova] Enqueued Resource ID: bb05091a-31fe-42f3-9fa7-22e070e414fa with Priority: HIGHEST for action port [ 787.157604] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_rules [ 787.157767] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 787.157900] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb05091a-31fe-42f3-9fa7-22e070e414fa with Priority: HIGHEST for action port [ 787.158196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.158354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.158445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.158651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.158767] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.160302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.160467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.160729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.161364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.161364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.161364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.162260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.162260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.162260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.162260] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.164404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb05091a-31fe-42f3-9fa7-22e070e414fa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.164538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.164616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.166809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.166809] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb05091a-31fe-42f3-9fa7-22e070e414fa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.668868] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.668868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.668868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.668868] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb05091a-31fe-42f3-9fa7-22e070e414fa with status ACTIVE [ 787.669307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.669307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.669307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.670410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.670410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.670410] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.670410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.670410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.673266] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.673266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.673266] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb05091a-31fe-42f3-9fa7-22e070e414fa is going to be updated. [ 787.696115] env[65319]: INFO networking_nsxv3.common.synchronization [req-307e1640-cf4b-426c-a03b-ea0b238837dd req-18ebd781-0ad6-4fc7-9bdd-563cc5d6e09f tempest-ServersAdminNegativeTestJSON-701324115 tempest-ServersAdminNegativeTestJSON-701324115-project-member] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 787.697149] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 787.697787] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.698215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.698531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.700024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.700024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.700024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.700024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.700024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.703300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.703300] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.732113] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.732113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.732113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.732113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.732113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.732113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb05091a-31fe-42f3-9fa7-22e070e414fa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.038711] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.039207] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.039412] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.039811] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.040288] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.040515] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.040696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.041353] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.041353] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.041661] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.041832] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.042048] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.042286] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.042388] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.042718] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.042718] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.065498] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.065961] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.068017] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.068017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.068017] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.068017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.068017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.068017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.068017] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.174405] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.204251] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.204434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.204524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.205085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.205227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.205441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.205551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.205612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.205790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.205868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.206049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff already deleted. [ 788.206207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.331634] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7ac30349-471c-4068-8142-39b24295d2a0 None None] Enqueued Resource ID: 26280500-024e-495f-942b-738a662d83d5 with Priority: HIGHEST for action port [ 788.335515] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26280500-024e-495f-942b-738a662d83d5 with Priority: HIGHEST for action port [ 788.335515] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-26280500-024e-495f-942b-738a662d83d5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.335515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26280500-024e-495f-942b-738a662d83d5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.335515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26280500-024e-495f-942b-738a662d83d5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.335515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26280500-024e-495f-942b-738a662d83d5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.335515] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26280500-024e-495f-942b-738a662d83d5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.342362] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b1cfd4d4-fb18-4bf9-8afd-00c5ca48784d None None] Enqueued Resource ID: 93c4ce5b-7626-4dc8-804f-d534755d9b66 with Priority: HIGHEST for action port [ 788.342994] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93c4ce5b-7626-4dc8-804f-d534755d9b66 with Priority: HIGHEST for action port [ 788.343753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-93c4ce5b-7626-4dc8-804f-d534755d9b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.344405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93c4ce5b-7626-4dc8-804f-d534755d9b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.344603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93c4ce5b-7626-4dc8-804f-d534755d9b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.344983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93c4ce5b-7626-4dc8-804f-d534755d9b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.345212] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c4ce5b-7626-4dc8-804f-d534755d9b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.571362] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.571622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.571622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.572047] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.572047] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.572204] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a not found, creating... [ 788.572492] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.572663] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.572793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573070] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.573220] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.573508] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.573663] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.573773] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573976] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.574153] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.574267] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a is going to be created. [ 788.597382] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.597669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.598058] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.598175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.598458] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.598703] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.677290] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.678024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.678024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.678024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.678127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.678209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be created. [ 788.746720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.746941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.747088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.747421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.747690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.777165] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: UNINITIALIZED for 2s [ 788.836385] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26280500-024e-495f-942b-738a662d83d5 [ 788.837259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.837259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.837259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.837259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.837259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.837710] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26280500-024e-495f-942b-738a662d83d5 already deleted. [ 788.841145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26280500-024e-495f-942b-738a662d83d5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.847683] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93c4ce5b-7626-4dc8-804f-d534755d9b66 [ 788.847916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.848074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.848144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.848360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.848440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.848536] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93c4ce5b-7626-4dc8-804f-d534755d9b66 already deleted. [ 788.848618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93c4ce5b-7626-4dc8-804f-d534755d9b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.368570] env[65319]: INFO networking_nsxv3.common.synchronization [req-307e1640-cf4b-426c-a03b-ea0b238837dd req-0c22b447-461c-4a74-8f77-95f496111fac service nova] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_rules [ 789.368729] env[65319]: INFO networking_nsxv3.common.synchronization [req-307e1640-cf4b-426c-a03b-ea0b238837dd req-0c22b447-461c-4a74-8f77-95f496111fac service nova] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 789.368729] env[65319]: INFO networking_nsxv3.common.synchronization [req-307e1640-cf4b-426c-a03b-ea0b238837dd req-0c22b447-461c-4a74-8f77-95f496111fac service nova] Enqueued Resource ID: 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a with Priority: HIGHEST for action port [ 789.369269] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_rules [ 789.369407] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 789.369505] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a with Priority: HIGHEST for action port [ 789.369775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.369942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.369982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.370226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.370306] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.371157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.371267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.371331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.371661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.371661] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.371783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.371783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.371910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.371991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.374322] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.374322] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.374322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.374322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.374322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.374322] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.876988] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.876988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.879625] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.880733] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a with status ACTIVE [ 789.880969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.881210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.881210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.881463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.881573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.881704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.881819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.882121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.882121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.882121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.882385] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.884500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.884634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.884791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.884974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.885100] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a is going to be updated. [ 789.915056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.915262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.915345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.915629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.916271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.916271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b97ee7b-6e5a-45ed-9f18-ac823dd07a8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.145024] env[65319]: INFO networking_nsxv3.common.synchronization [req-10ec4222-6831-40e5-90a6-c3e52ec15c1e req-797c05f6-45a1-4cdd-8078-a7e1eb09b4b8 tempest-FloatingIPsAssociationTestJSON-2127283809 tempest-FloatingIPsAssociationTestJSON-2127283809-project-member] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 790.146020] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 790.146362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.146580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.146666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.146989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.147739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.147739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.147739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.147739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.147739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.147739] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.391247] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.586630] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.587683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588113] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.588350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.588657] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588907] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588985] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.589259] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.589425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.589653] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.589775] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.589881] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.589993] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.590112] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.590209] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.590339] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.612030] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.612030] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.612030] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.612030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-324" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.612030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.612030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.612429] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.612899] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.612899] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad83cdee-84c5-4e7d-ae14-9b07d265ce27',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.651391] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.787778] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 790.788032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.788201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.788511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.788676] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.790096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.790096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.790096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.790096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.790096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.790096] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.894922] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.895423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.895423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.895667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.895822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.895979] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be created. [ 790.922337] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.922554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.922554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.922819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.923027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.936884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: UNINITIALIZED for 2s [ 791.116601] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.116898] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.117044] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.117314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.117456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.118031] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port ad83cdee-84c5-4e7d-ae14-9b07d265ce27 not found, creating... [ 791.118031] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.118031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.118227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.118328] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.118456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.118730] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.118877] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.119179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.119179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.119310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.119462] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: ad83cdee-84c5-4e7d-ae14-9b07d265ce27 is going to be created. [ 791.144478] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.144797] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.145069] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.145335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.145590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.145834] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.154157] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.294494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.294494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.294494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.294494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.294494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.295343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.295343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.295343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.295697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.295930] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.496365] env[65319]: INFO networking_nsxv3.common.synchronization [None req-1e2f6ffd-2698-4745-ac58-aba1d7a6370c None None] Enqueued Resource ID: 16df14ec-bb63-4db5-9bc2-1de2210f3c74 with Priority: HIGHEST for action port [ 791.497216] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16df14ec-bb63-4db5-9bc2-1de2210f3c74 with Priority: HIGHEST for action port [ 791.497832] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-16df14ec-bb63-4db5-9bc2-1de2210f3c74 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.498045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16df14ec-bb63-4db5-9bc2-1de2210f3c74" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.498154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16df14ec-bb63-4db5-9bc2-1de2210f3c74" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.498516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16df14ec-bb63-4db5-9bc2-1de2210f3c74" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.498651] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16df14ec-bb63-4db5-9bc2-1de2210f3c74',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.656824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.657015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.657119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.657327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.657419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.657518] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 791.688897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.689062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.689161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.689418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.689575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.699763] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 791.800220] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21b6477e-560e-44cf-bf38-d612f918ff7e: rpc.has_security_group_logging(os_id): False [ 791.829153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.829343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.829385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.829617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.829715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.829923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.830038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.830101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.830260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.830368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.830581] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.830686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.830747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.830926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.831401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.831730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.831856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.831932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.832274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.832363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.832457] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be created. [ 791.902424] env[65319]: INFO networking_nsxv3.common.synchronization [req-d9b67da0-2562-4fbd-acc1-bb3d5ff3a701 req-d52706ee-6608-42af-9770-d1cf0633b793 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 791.907345] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 791.907345] env[65319]: INFO networking_nsxv3.common.synchronization [req-10ec4222-6831-40e5-90a6-c3e52ec15c1e req-0d50c49b-be0e-41da-b7cf-aa261db8a7ce service nova] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_rules [ 791.907345] env[65319]: INFO networking_nsxv3.common.synchronization [req-10ec4222-6831-40e5-90a6-c3e52ec15c1e req-0d50c49b-be0e-41da-b7cf-aa261db8a7ce service nova] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 791.907345] env[65319]: INFO networking_nsxv3.common.synchronization [req-10ec4222-6831-40e5-90a6-c3e52ec15c1e req-0d50c49b-be0e-41da-b7cf-aa261db8a7ce service nova] Enqueued Resource ID: ad83cdee-84c5-4e7d-ae14-9b07d265ce27 with Priority: HIGHEST for action port [ 791.907345] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.907345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.907345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.907985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.907985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.908114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.908349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.908643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.908726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.908887] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.910610] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_rules [ 791.911092] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 791.911092] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad83cdee-84c5-4e7d-ae14-9b07d265ce27 with Priority: HIGHEST for action port [ 791.911460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.911599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.912113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.912113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.912113] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.912929] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.913057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.913237] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.913632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.913632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.914465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.914465] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad83cdee-84c5-4e7d-ae14-9b07d265ce27',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.937473] env[65319]: INFO networking_nsxv3.common.synchronization [req-d9b67da0-2562-4fbd-acc1-bb3d5ff3a701 req-d52706ee-6608-42af-9770-d1cf0633b793 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 791.938547] env[65319]: INFO networking_nsxv3.common.synchronization [req-d9b67da0-2562-4fbd-acc1-bb3d5ff3a701 req-d52706ee-6608-42af-9770-d1cf0633b793 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 791.938756] env[65319]: INFO networking_nsxv3.common.synchronization [req-d9b67da0-2562-4fbd-acc1-bb3d5ff3a701 req-d52706ee-6608-42af-9770-d1cf0633b793 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 791.941127] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 791.941350] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 791.941490] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 791.941820] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.941962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.942040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.942246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.942332] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.943723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.943837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1c7689-5943-46c9-9b05-0929713f0a53 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.944502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.944895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.945022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1c7689-5943-46c9-9b05-0929713f0a53',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.948162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.948290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.948361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.948559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.948769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.976559] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 792.006021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16df14ec-bb63-4db5-9bc2-1de2210f3c74 [ 792.006021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.006021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.006021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.006021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.006021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.006021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16df14ec-bb63-4db5-9bc2-1de2210f3c74 already deleted. [ 792.006021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16df14ec-bb63-4db5-9bc2-1de2210f3c74" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.416749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.416749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.416886] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.418474] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad83cdee-84c5-4e7d-ae14-9b07d265ce27 with status ACTIVE [ 792.418663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.418777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.420149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.420149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.420149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.420991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.421452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.421452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.421452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.421690] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad83cdee-84c5-4e7d-ae14-9b07d265ce27 is going to be updated. [ 792.445271] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.445468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.445517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.445711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.445865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.446014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad83cdee-84c5-4e7d-ae14-9b07d265ce27" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.446334] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.446474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.446689] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1c7689-5943-46c9-9b05-0929713f0a53 with status ACTIVE [ 792.446862] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.446966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.447790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.448620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.448620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.448620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.448620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.448620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.448620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.449108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.449108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.449108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.449108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.449240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.449343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.449403] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 is going to be updated. [ 792.479132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.479406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.479535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.479785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.480112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.480795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.924628] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.950187] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 792.951616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.951616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.951616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.951877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.952212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.952278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.952535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.952706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.953494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.953494] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.428308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.428579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.428579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.428775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.428964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 793.458503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.458850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.458850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.459082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.459448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.459658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.459717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.459920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.460047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.460164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.460375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.460492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.460573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.460766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.460945] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.467869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.467869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.467869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.467869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.467869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.467869] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.468433] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.468433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.468433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.468433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.468433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.482118] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 793.714630] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.714630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.714630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.714630] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.970870] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 196d2ce6-1e48-4442-a132-6f23fe6096ff: rpc.has_security_group_logging(os_id): False [ 793.996073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.996073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.996073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.996607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.996607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.996607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.996607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.996774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.996880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.999355] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.999355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.999355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.999355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.999740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.999777] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be created. [ 794.003656] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 794.004014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.071396] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.071572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.071611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.071837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.072046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.085576] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 794.219023] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.719928] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.222776] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.223143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.223143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.223404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.223929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.223929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 795.266681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.266874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.266942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.267140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.267511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.280338] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 795.494187] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 795.494632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.494920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.495259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.495651] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.497523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.497698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.497946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.498151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.498151] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.579146] env[65319]: INFO networking_nsxv3.common.synchronization [req-7454344a-f5d2-4f3d-bb6b-772505d9e9e4 req-bad1cb95-6e1d-4675-901b-b33244a99454 tempest-ListImageFiltersTestJSON-1347272766 tempest-ListImageFiltersTestJSON-1347272766-project-member] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 795.579946] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 795.581098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.581320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.581320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.581682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.581773] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.582040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.582040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.582313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.582434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.582539] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.000564] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.085593] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.101321] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 796.101557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.122479] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.122723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.122850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.123273] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.123603] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.123727] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.123871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.124186] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.124415] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.124699] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.124848] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.124980] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.125308] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.125308] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.125770] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.125770] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.153637] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.153637] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.153637] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.153637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.153637] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-7a3f10fa-65b2-4bfe-8a54-93be4491819f taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.153637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.153637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.154375] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.154582] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3f10fa-65b2-4bfe-8a54-93be4491819f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.504948] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.589443] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.658512] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.658830] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.659031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.659462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.659699] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.659937] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 7a3f10fa-65b2-4bfe-8a54-93be4491819f not found, creating... [ 796.661268] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.661268] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.661268] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.661268] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.661512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.661918] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.661983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.662186] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.662511] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.663311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.663311] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 7a3f10fa-65b2-4bfe-8a54-93be4491819f is going to be created. [ 796.689841] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.690158] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.690357] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.690748] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.691113] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.691447] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.007330] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.007579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.007635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.007891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.007976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.008089] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 797.061494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.061706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.061790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.063439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.063673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.067999] env[65319]: INFO networking_nsxv3.common.synchronization [req-49eb1357-5f39-4a09-b696-bebba93c598e req-216322a4-2e11-420e-b063-743867270c44 tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 797.069037] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 797.069037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.069240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.069240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.069413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.069605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.069605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.069699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.070269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.070477] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.084694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 797.091925] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.091925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.092129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.092200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.092302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.092376] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 797.165560] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.165744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.165834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.166068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.166229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.182081] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 797.290420] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 797.290922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.291324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.291389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.291680] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.291789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.291858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.292121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.292242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.292361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.292497] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.482232] env[65319]: INFO networking_nsxv3.common.synchronization [req-7454344a-f5d2-4f3d-bb6b-772505d9e9e4 req-677f203c-032f-4745-9ba5-5db5f3ac8869 service nova] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_rules [ 797.482569] env[65319]: INFO networking_nsxv3.common.synchronization [req-7454344a-f5d2-4f3d-bb6b-772505d9e9e4 req-677f203c-032f-4745-9ba5-5db5f3ac8869 service nova] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 797.482759] env[65319]: INFO networking_nsxv3.common.synchronization [req-7454344a-f5d2-4f3d-bb6b-772505d9e9e4 req-677f203c-032f-4745-9ba5-5db5f3ac8869 service nova] Enqueued Resource ID: 7a3f10fa-65b2-4bfe-8a54-93be4491819f with Priority: HIGHEST for action port [ 797.483458] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_rules [ 797.483556] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 797.483642] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a3f10fa-65b2-4bfe-8a54-93be4491819f with Priority: HIGHEST for action port [ 797.483895] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.484039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.484131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.484304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.484598] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.486229] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.486229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.486467] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a3f10fa-65b2-4bfe-8a54-93be4491819f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.486582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.486652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.486849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.486932] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3f10fa-65b2-4bfe-8a54-93be4491819f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.574755] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.795638] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.795825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.795899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.796148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.796382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.796495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.796556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.796717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.796823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.796879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.797077] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.797172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.797241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.797387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.797538] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.797632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.797684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.797873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.797993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.798101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.798199] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.992961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.992961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.992961] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a3f10fa-65b2-4bfe-8a54-93be4491819f with status ACTIVE [ 797.992961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.993347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.993347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.993347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.993451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.993559] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.993650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.993708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.993860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.993934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.995202] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.995202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.995202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.995416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.995416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.995416] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a3f10fa-65b2-4bfe-8a54-93be4491819f is going to be updated. [ 798.028959] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.029131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.029205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.029424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.029564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.029723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a3f10fa-65b2-4bfe-8a54-93be4491819f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.079109] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.285428] env[65319]: INFO networking_nsxv3.common.synchronization [req-edc9a9f6-2f5c-41e2-b649-00fcfabf2b67 req-34180488-fd87-4eb5-9a6a-78cc5351e358 tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 798.286084] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 798.287569] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.287569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.287569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.287569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.288224] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.288224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.288224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.288224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.288224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.289165] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.304985] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c15410b-c953-4795-bf47-b964e640b74b: rpc.has_security_group_logging(os_id): False [ 798.327833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.327989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.328075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.328293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.349434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.350216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.350216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.350216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.350495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.350495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.350689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.350834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.350923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.351138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.351260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.351554] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.351641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.351754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.351938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.352294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.352294] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 798.433641] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.433641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.433641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.433641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.433641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.471634] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 798.533049] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0a77ffe-fc46-4998-b50d-84ef64699fc6 req-0368be84-0c31-403d-ac9d-29d4ee9e7904 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 798.533261] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 798.533587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.533703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.553786] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0a77ffe-fc46-4998-b50d-84ef64699fc6 req-0368be84-0c31-403d-ac9d-29d4ee9e7904 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 798.554610] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0a77ffe-fc46-4998-b50d-84ef64699fc6 req-0368be84-0c31-403d-ac9d-29d4ee9e7904 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 798.555032] env[65319]: INFO networking_nsxv3.common.synchronization [req-c0a77ffe-fc46-4998-b50d-84ef64699fc6 req-0368be84-0c31-403d-ac9d-29d4ee9e7904 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 798.555738] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_rules [ 798.556921] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 798.557148] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 with Priority: HIGHEST for action port [ 798.557729] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.557889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.558188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.558340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.558599] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1c7689-5943-46c9-9b05-0929713f0a53 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.558748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.558844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.559214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.559270] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1c7689-5943-46c9-9b05-0929713f0a53',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.583566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.584058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.584058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.584336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.584336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.584585] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 798.645496] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.645706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.645805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.646064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.646256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.662694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 798.757860] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.758192] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.758377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.758607] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.758891] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.759067] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.759181] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.759389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.759527] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.759726] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.759831] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.760070] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.760070] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.760173] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.760241] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.760364] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.792200] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.792401] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.792539] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.792745] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-828" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.793046] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-373f04a1-4130-4668-b4cc-2fdd28cd3925 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.793225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.793375] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.793693] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.793829] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('373f04a1-4130-4668-b4cc-2fdd28cd3925',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.796222] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.020850] env[65319]: INFO networking_nsxv3.common.synchronization [req-2b44a6e6-dd3a-47a8-86fb-c1b2e510ea46 req-8be3c289-8a23-485b-b6c4-be5bc4437f7c tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 799.022669] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 799.023610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.023864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.024039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.024418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.024686] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.024900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.025070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.025372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.025566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.025793] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.063151] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1c7689-5943-46c9-9b05-0929713f0a53 with status ACTIVE [ 799.063386] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.063548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.063626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.064028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.064028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.064140] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.064222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.064268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.064442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.064549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.064772] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.064893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.064978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.065168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.065276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.065411] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1c7689-5943-46c9-9b05-0929713f0a53 is going to be updated. [ 799.089401] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.089601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.089658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.089829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.089969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.090150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1c7689-5943-46c9-9b05-0929713f0a53" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.097696] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 799.097880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.098062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.098295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.098494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.098615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.098684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.098921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.098921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.099094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.099094] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.101493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.101710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.101904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.102040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.102106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.102266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.102444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.103350] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.197927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 799.198179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.198376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.198642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.198848] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.198997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.199073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.199259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.199348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.199482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.298358] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.300191] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.301730] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.301943] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.302372] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.302535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.302729] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 373f04a1-4130-4668-b4cc-2fdd28cd3925 not found, creating... [ 799.303087] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.303426] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.303426] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.303681] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.303823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.304165] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.304570] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.304690] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.305090] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.305304] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.305633] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 373f04a1-4130-4668-b4cc-2fdd28cd3925 is going to be created. [ 799.346348] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.346648] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.346781] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.347151] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.347326] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.347833] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.528428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.528687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.529103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.529224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.561246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.561498] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.561670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.561756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.562020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.562099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.562176] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 799.604711] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.605103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.605103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.605318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.605501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.606665] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.607832] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.623682] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 799.702597] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.807979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.808163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.809346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.809346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.809346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.809346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 799.871319] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.871319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.871319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.871319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.871319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.888986] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [req-edc9a9f6-2f5c-41e2-b649-00fcfabf2b67 req-5d9ca92a-90c2-4a59-ac38-cea39862dd3c service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [req-edc9a9f6-2f5c-41e2-b649-00fcfabf2b67 req-5d9ca92a-90c2-4a59-ac38-cea39862dd3c service nova] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [req-edc9a9f6-2f5c-41e2-b649-00fcfabf2b67 req-5d9ca92a-90c2-4a59-ac38-cea39862dd3c service nova] Enqueued Resource ID: 373f04a1-4130-4668-b4cc-2fdd28cd3925 with Priority: HIGHEST for action port [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_rules [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 800.049926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373f04a1-4130-4668-b4cc-2fdd28cd3925 with Priority: HIGHEST for action port [ 800.049926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.052078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.052078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.052078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.052078] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.053903] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.053903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.053903] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-373f04a1-4130-4668-b4cc-2fdd28cd3925 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.054400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.054551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.055771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.055771] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('373f04a1-4130-4668-b4cc-2fdd28cd3925',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.110206] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b6be49-7325-4aa1-a882-59916b0da354: rpc.has_security_group_logging(os_id): False [ 800.112908] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.131712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.132239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.132384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.132677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.162428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.162428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.162428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.162428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.162428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.162428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.162428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 800.205578] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.236272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.236272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.236272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.236613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.237910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.254942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 800.498278] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 800.498278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.556964] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.557152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.558679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 373f04a1-4130-4668-b4cc-2fdd28cd3925 with status ACTIVE [ 800.558679] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.558679] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.558679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.559186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.559186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.559186] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.559186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.559410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.559410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.559591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.559626] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 373f04a1-4130-4668-b4cc-2fdd28cd3925 is going to be updated. [ 800.593096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.593205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.593278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.594135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.594135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.594135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-373f04a1-4130-4668-b4cc-2fdd28cd3925" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.617189] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.617541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.617541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.617646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.617740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.617860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 800.665480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.665656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.665710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.667445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.667445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.694249] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 800.695364] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 800.695813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.707592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.707793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.707887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.708228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.708464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.708464] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 800.767029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.767029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.767029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.767029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.767029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.778181] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 800.873803] env[65319]: INFO networking_nsxv3.common.synchronization [req-dbe324d8-069b-4856-a7d7-a2c56eb5dd63 req-66885b13-9f3d-416e-a641-016cb614fa80 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 800.873803] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 800.873803] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.874639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.874744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.874943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.875325] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.875325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.875325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.875541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.875628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.875725] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.269126] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.269126] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.269126] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.269126] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.269126] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.270160] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.270685] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.271034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.271382] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.271976] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.272408] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.272841] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.273717] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.273965] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.274530] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.274915] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.295820] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.296070] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.296196] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.296332] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.296655] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.296845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.296957] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.297320] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.297483] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8711e4c3-2cea-48ff-bdae-47a2bb20d61c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.377972] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.378187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.378270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.378566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.409788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.410154] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.410294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.410349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.410569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.410793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.410793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 801.459496] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.459721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.459721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.460021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.460204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.472103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 801.519791] env[65319]: INFO networking_nsxv3.common.synchronization [req-c53b7aba-ae80-445e-a9a5-28d39498e355 req-28711dee-1810-43df-8c5a-06cf39ca5e38 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 801.520427] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 801.520782] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.520922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.520988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.521219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.521380] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.521479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.521540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.521689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.521777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.521871] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.638531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 801.638531] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 801.638531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.800461] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.800461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.800461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.800461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.800461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.800690] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 8711e4c3-2cea-48ff-bdae-47a2bb20d61c not found, creating... [ 801.800896] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.801104] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.801257] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.801573] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.801793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.802085] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.802269] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.802383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.802603] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.802735] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.802876] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 8711e4c3-2cea-48ff-bdae-47a2bb20d61c is going to be created. [ 801.852415] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.852662] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.852844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.853229] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.853808] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.853808] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.900925] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 801.902189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.902189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.902189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.902509] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.902509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.902509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.902741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.902867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.903032] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.983702] env[65319]: INFO networking_nsxv3.common.synchronization [req-c983a8f9-650a-4074-adbc-de83656c02e4 req-6310296b-c87e-4ba9-8dc0-bfd37bfe19a3 tempest-ServerActionsV293TestJSON-1314727380 tempest-ServerActionsV293TestJSON-1314727380-project-member] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 801.984330] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGHEST for action security_group_members [ 801.984683] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.984828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.984895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.985107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.985268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.985370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.985435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.985590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.985674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.985769] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.024261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.024557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.024647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.024899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.050155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.050594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.050799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.050912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.051234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.051393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.051554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be updated. [ 802.097780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.098036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.098036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.098234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.098397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.130209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: IN_PROGRESS for 2s [ 802.274525] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 802.274525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.274664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.274845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.274948] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.405232] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.488083] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.488342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.488342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.489462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.518545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.518545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.518704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.518704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.518909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.518994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.519098] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30580859-8cff-47d8-a383-cb85009ec257 is going to be updated. [ 802.563368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.563525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.563563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.563805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.563956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.576173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: IN_PROGRESS for 2s [ 802.604737] env[65319]: INFO networking_nsxv3.common.synchronization [req-dbe324d8-069b-4856-a7d7-a2c56eb5dd63 req-b96bcd3d-8838-4474-9d0e-751a7e440c7c service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 802.604974] env[65319]: INFO networking_nsxv3.common.synchronization [req-dbe324d8-069b-4856-a7d7-a2c56eb5dd63 req-b96bcd3d-8838-4474-9d0e-751a7e440c7c service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 802.605185] env[65319]: INFO networking_nsxv3.common.synchronization [req-dbe324d8-069b-4856-a7d7-a2c56eb5dd63 req-b96bcd3d-8838-4474-9d0e-751a7e440c7c service nova] Enqueued Resource ID: 8711e4c3-2cea-48ff-bdae-47a2bb20d61c with Priority: HIGHEST for action port [ 802.606100] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 802.606100] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 802.606100] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8711e4c3-2cea-48ff-bdae-47a2bb20d61c with Priority: HIGHEST for action port [ 802.606397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.606568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.606704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.607065] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.608010] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.608157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.608469] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.608692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.608802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.609079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.609403] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8711e4c3-2cea-48ff-bdae-47a2bb20d61c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.710193] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 802.710475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.710667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.710884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.711097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.711202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.711296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.711423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.711505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.711602] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.780519] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.780519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.802980] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 802.802980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.802980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.802980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.803285] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.803285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.803285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.803405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.803438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.803520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.803614] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.909252] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.111392] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.111614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.111826] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8711e4c3-2cea-48ff-bdae-47a2bb20d61c with status ACTIVE [ 803.112089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.112257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.112361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.112674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.112797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.113063] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.113207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.113298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.113564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.113682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.115491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.115491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.115491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.115491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.115491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.115491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8711e4c3-2cea-48ff-bdae-47a2bb20d61c is going to be updated. [ 803.142963] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.143210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.143302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.143577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.143726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.143943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8711e4c3-2cea-48ff-bdae-47a2bb20d61c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.214541] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.306438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.306663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.306833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.307563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.307563] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.307563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.307563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.307813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.307898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.308060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.308245] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.308347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.308412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.308600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.308790] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.308918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.308999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.309205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.309415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.309456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.309531] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.413019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.413230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.413306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.413568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.413693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.413814] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 803.454915] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.455023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.455023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.456081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.456081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.473023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 803.564414] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 803.564642] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 803.564764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.564956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.565212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.565978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.565978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.565978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.565978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.565978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.566272] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.716962] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.811812] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21b6477e-560e-44cf-bf38-d612f918ff7e: rpc.has_security_group_logging(os_id): False [ 803.850860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.850978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.851057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.851288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.851382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.851906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.851906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.852053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.852180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.852259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.852488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.852580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.852647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.852818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.852874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.857024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.857024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.857024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.857024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.857024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.857024] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 803.951681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.952894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.952894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.952894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.953112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.971189] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 804.068797] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.149131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 804.149131] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 deletion is rescheduled due to dependency. [ 804.149252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.219881] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.220099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.220157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.220356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.220447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.220547] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 804.249738] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.249948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.249948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.250193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.250333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.259763] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 804.571159] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.590475] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30580859-8cff-47d8-a383-cb85009ec257 in Status: SUCCESS [ 804.590674] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30580859-8cff-47d8-a383-cb85009ec257 deletion is rescheduled due to dependency. [ 804.590828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.073895] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.074333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.074333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.074556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.074633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.074736] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 805.092049] env[65319]: INFO networking_nsxv3.common.synchronization [req-5fb19095-5c17-44ff-ad85-5bd578b97a05 req-d6a893a0-8c34-4e9f-915d-135b950354cb tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 805.092977] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 805.093375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.093506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.093506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.093728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.093919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.094062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.094121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.094338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.094590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.094590] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.115506] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.115740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.116169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.116646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.116963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.129131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 805.489324] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 805.490013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.490013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.490013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.490379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.490379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.490490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.490585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.490647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.490856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.490856] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.593498] env[65319]: INFO networking_nsxv3.common.synchronization [req-2f15bbe1-b4dc-47b4-9a58-36c0147b60b1 req-2bac4430-77c3-4df1-8fd8-c0e12948d9e6 tempest-AttachInterfacesUnderV243Test-1544693093 tempest-AttachInterfacesUnderV243Test-1544693093-project-member] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 805.594926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGHEST for action security_group_members [ 805.595365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.596069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.598526] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.598526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.598526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.598723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.598856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.599442] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.599442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.599442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.599442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.599676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.599774] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 805.637088] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.637267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.637365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.638013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.638236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.649526] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 805.986894] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 805.987439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.996624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.996624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.996624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.996624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.996908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.997052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.997147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.997359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.997480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.997614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.998239] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.998407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.998534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.998719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.998967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.999136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.999229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.999418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.999549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.999665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.999788] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.275659] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 806.276054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.276054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.276275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.279493] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.279493] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.279493] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.279493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.280050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.280050] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.338226] env[65319]: INFO networking_nsxv3.common.synchronization [req-a885a85d-1cab-49ba-900e-2dac57e7335f req-beadb9b8-6cd1-44f1-8dec-96461f1202c2 tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 806.338226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 806.338226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.338226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.338226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.338226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.339084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.342030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.342030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.342030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.342030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.342030] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.503241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31328668-cad5-4bcc-9c72-54d3bf9877fe: rpc.has_security_group_logging(os_id): False [ 806.528358] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.528529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.528620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.529055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.550524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.550825] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.550945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.551023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.551241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.551329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.551520] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.551645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.551705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.551856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.551958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.552193] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.552325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.552510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.552722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.552815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.552914] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 806.624528] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.624693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.624693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.624943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.625157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.646304] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 806.779919] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.785588] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.785780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.785845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.786114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.786114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.786321] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.786438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.786583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.786690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.786867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.786867] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 806.813459] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.814205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.814205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.814680] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.815352] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.815352] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.816087] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.816087] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.816087] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.816631] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.816631] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.816631] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.816831] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.817429] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.817429] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.817429] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.846123] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.846123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.846311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.846425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.846583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.846722] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.846822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.846878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.847051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.847121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.847275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 already deleted. [ 806.847362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.865240] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.865520] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.865591] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.865748] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.866095] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-669311a6-e418-4aa5-9181-0e3278135a85 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.866240] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.866351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.866873] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.868479] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669311a6-e418-4aa5-9181-0e3278135a85',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.871194] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.871316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.871383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.871575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.871708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.881187] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 807.139952] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 807.140241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.140458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.140705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.140970] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.141150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.141216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.141469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.141469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.141586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.141775] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.285930] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b6be49-7325-4aa1-a882-59916b0da354: rpc.has_security_group_logging(os_id): False [ 807.306017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.306267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.306339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.307326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.307326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.307883] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.308095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.308131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.309647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.309647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.309647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be updated. [ 807.371744] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.372183] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.372362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.372674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.372889] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.373083] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 669311a6-e418-4aa5-9181-0e3278135a85 not found, creating... [ 807.373368] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.373548] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.373676] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.373922] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.374123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.374443] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.374665] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.374754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.374943] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.375088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.375226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 669311a6-e418-4aa5-9181-0e3278135a85 is going to be created. [ 807.377245] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.377380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.377427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.377671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.377808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.399458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: IN_PROGRESS for 2s [ 807.411816] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412140] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.412140] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.412468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.413162] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.413452] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.644117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.644516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.644516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.644748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.644918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.645079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.645182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.645373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.645486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.645867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.645867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.646059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.646173] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.646485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.646589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.646735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.646822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.646895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.646991] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.667459] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 807.667710] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 deletion is rescheduled due to dependency. [ 807.667795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.097251] env[65319]: INFO networking_nsxv3.common.synchronization [req-a885a85d-1cab-49ba-900e-2dac57e7335f req-76b0c554-250a-4f4e-8104-492aa8ffdb78 service nova] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 808.097427] env[65319]: INFO networking_nsxv3.common.synchronization [req-a885a85d-1cab-49ba-900e-2dac57e7335f req-76b0c554-250a-4f4e-8104-492aa8ffdb78 service nova] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 808.097573] env[65319]: INFO networking_nsxv3.common.synchronization [req-a885a85d-1cab-49ba-900e-2dac57e7335f req-76b0c554-250a-4f4e-8104-492aa8ffdb78 service nova] Enqueued Resource ID: 669311a6-e418-4aa5-9181-0e3278135a85 with Priority: HIGHEST for action port [ 808.098615] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_rules [ 808.106043] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 808.106043] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669311a6-e418-4aa5-9181-0e3278135a85 with Priority: HIGHEST for action port [ 808.106043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.106043] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.106043] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.106043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.106604] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.106604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.106725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.106885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.106947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.107045] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.110025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-669311a6-e418-4aa5-9181-0e3278135a85 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.110191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.110244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.110373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.110500] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669311a6-e418-4aa5-9181-0e3278135a85',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.149105] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d51d74c1-0bc9-4f08-9e69-0f36720ce33b: rpc.has_security_group_logging(os_id): False [ 808.321400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.321400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.321400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.321400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.321400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.322127] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.322127] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.322127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.324624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.324624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.324624] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 808.402762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.402958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.402958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.403276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.403364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.421454] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 808.611905] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.614221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.614221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.614221] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 669311a6-e418-4aa5-9181-0e3278135a85 with status ACTIVE [ 808.614221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.614221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.614221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.614221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.614221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.614620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.614620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.614620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.614620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.614742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.615484] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.615484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.615484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.615484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.615484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.615484] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 669311a6-e418-4aa5-9181-0e3278135a85 is going to be updated. [ 808.640301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.640502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.640502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.640852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.640852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.641063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-669311a6-e418-4aa5-9181-0e3278135a85" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.666453] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 808.666679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.891713] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 808.891713] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 deletion is rescheduled due to dependency. [ 808.891917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.118486] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.423019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b6be49-7325-4aa1-a882-59916b0da354 in Status: SUCCESS [ 809.423019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.627258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.627258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.627258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.627258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.627258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.627258] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 is going to be created. [ 809.654251] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.654524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.654616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.654814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.656037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.668431] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: UNINITIALIZED for 2s [ 810.437049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 810.437757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.522129] env[65319]: INFO networking_nsxv3.common.synchronization [req-d42cc760-8f46-4c63-80f2-9b8dec9d55c4 req-cf7954ff-4d05-49f9-9d99-89cba4dc4026 tempest-InstanceActionsTestJSON-2126032322 tempest-InstanceActionsTestJSON-2126032322-project-member] Enqueued Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 811.522782] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 811.523124] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.523243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.523310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.523569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.523728] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.523831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.523886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.524047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.524132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.524225] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.680179] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: SUCCESS [ 811.680275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.681532] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.681532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.681532] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.938406] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.938610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-537" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.938731] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-537" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.939192] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-537" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.939351] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.939502] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.939613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.939827] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.939969] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.940301] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.940446] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.940578] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.940715] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.940901] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.941046] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.941213] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.004818] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.005783] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.064 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.006083] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.006339] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-537" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.006842] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-92acc456-d69f-4216-8443-fa0a8c9b71bf taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.007084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.007242] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.007597] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.007771] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92acc456-d69f-4216-8443-fa0a8c9b71bf',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.029413] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.029652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.030395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.030989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.031159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.032024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.032024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.032024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.032024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.032414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.039028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 already deleted. [ 812.039028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.184482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.510064] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.510360] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.510460] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.510707] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.510856] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.511016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 92acc456-d69f-4216-8443-fa0a8c9b71bf not found, creating... [ 812.511287] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.511517] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.511609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.511861] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.512020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.512377] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.512565] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.512700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.512909] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.513047] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.513203] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 92acc456-d69f-4216-8443-fa0a8c9b71bf is going to be created. [ 812.544735] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.545296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.545296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.545535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.545775] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.545992] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.687770] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64c67b2e-cc70-45f4-b07c-aa5250deaa33: rpc.has_security_group_logging(os_id): False [ 812.717181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.717483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.717483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.717633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.717727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.717983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.718095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.718157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.718313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.718384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.718466] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 is going to be created. [ 812.802974] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.803211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.803289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.803502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.803691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.832131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: IN_PROGRESS for 2s [ 813.297210] env[65319]: INFO networking_nsxv3.common.synchronization [req-d42cc760-8f46-4c63-80f2-9b8dec9d55c4 req-4b575541-5449-4e79-ab9b-68c2f5415242 service nova] Enqueued Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_rules [ 813.297492] env[65319]: INFO networking_nsxv3.common.synchronization [req-d42cc760-8f46-4c63-80f2-9b8dec9d55c4 req-4b575541-5449-4e79-ab9b-68c2f5415242 service nova] Enqueued Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 813.297658] env[65319]: INFO networking_nsxv3.common.synchronization [req-d42cc760-8f46-4c63-80f2-9b8dec9d55c4 req-4b575541-5449-4e79-ab9b-68c2f5415242 service nova] Enqueued Resource ID: 92acc456-d69f-4216-8443-fa0a8c9b71bf with Priority: HIGHEST for action port [ 813.299840] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_rules [ 813.300507] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 813.300643] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92acc456-d69f-4216-8443-fa0a8c9b71bf with Priority: HIGHEST for action port [ 813.300914] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.301096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.301096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.302289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.302396] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.303968] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.304105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.304249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.306471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.306471] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.306471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-92acc456-d69f-4216-8443-fa0a8c9b71bf taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.306471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.307228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.307228] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92acc456-d69f-4216-8443-fa0a8c9b71bf',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.809080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.809080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.809080] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.810386] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92acc456-d69f-4216-8443-fa0a8c9b71bf with status ACTIVE [ 813.810386] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.810386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.810386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.810543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.810543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.810934] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.811015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.811088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.811322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.812225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.812225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.812225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.812225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.812225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.812225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.812225] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92acc456-d69f-4216-8443-fa0a8c9b71bf is going to be updated. [ 813.845316] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.845525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.845525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.845912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.845912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.846118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92acc456-d69f-4216-8443-fa0a8c9b71bf" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.314014] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.372231] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edea149-c443-42c6-95b3-eea6c659131a req-312723f7-9d9c-4aae-ba2d-5464626a3d93 tempest-AttachInterfacesV270Test-859276709 tempest-AttachInterfacesV270Test-859276709-project-member] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 814.372790] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 814.373121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.373249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.373312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.373650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.373865] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.373976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.374471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.374652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.374752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.374853] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.782188] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-763 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.782188] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-763" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.785229] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-763" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.785726] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-763" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.786190] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.786467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.786656] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.787017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.787243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.787582] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.787778] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.788045] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.788102] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.788271] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.788412] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.788562] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.811357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.811738] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.811848] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.812044] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-763" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.812377] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-b8c8499d-aae2-4bde-bb75-7af47bc6d745 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.812572] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.812699] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.813332] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.813521] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c8499d-aae2-4bde-bb75-7af47bc6d745',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.818333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.818456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.818495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.818715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.818814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.818901] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 is going to be created. [ 814.859796] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: SUCCESS [ 814.859796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.864697] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.865483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.865483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.865753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.866442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.877764] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.877764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.877764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.878337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.878630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.879021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.884028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.884028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.884028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.884028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.884028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31e5352-a147-470a-ab00-4f2c60273287 already deleted. [ 814.884028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.886285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: UNINITIALIZED for 2s [ 815.318880] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.319103] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.319287] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.319591] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.319734] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.319906] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port b8c8499d-aae2-4bde-bb75-7af47bc6d745 not found, creating... [ 815.320201] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.320358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.320490] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.320730] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.321034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.321206] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.321362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.321523] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.321801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.322682] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.322682] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: b8c8499d-aae2-4bde-bb75-7af47bc6d745 is going to be created. [ 815.347232] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.347232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.347232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.347232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.347232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.347232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767667] env[65319]: INFO networking_nsxv3.common.synchronization [req-5e946d36-d75f-488f-b198-3832298bc2dd req-8b665599-9940-4cb5-9e89-278040042215 tempest-FloatingIPsAssociationTestJSON-2127283809 tempest-FloatingIPsAssociationTestJSON-2127283809-project-member] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 815.768397] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 815.768823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.769018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.769169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.769477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.769731] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.769900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.770028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.770288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.770423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.770552] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.109664] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edea149-c443-42c6-95b3-eea6c659131a req-d5989c50-683c-4a3c-b5bb-fad6820c260e service nova] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_rules [ 816.109664] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edea149-c443-42c6-95b3-eea6c659131a req-d5989c50-683c-4a3c-b5bb-fad6820c260e service nova] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 816.110037] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edea149-c443-42c6-95b3-eea6c659131a req-d5989c50-683c-4a3c-b5bb-fad6820c260e service nova] Enqueued Resource ID: b8c8499d-aae2-4bde-bb75-7af47bc6d745 with Priority: HIGHEST for action port [ 816.110840] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_rules [ 816.110993] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 816.111143] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c8499d-aae2-4bde-bb75-7af47bc6d745 with Priority: HIGHEST for action port [ 816.111486] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.111649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.111789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.112046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.112136] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.113320] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.113789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.113945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.114295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.116766] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.116766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.116766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.116766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.116766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.116766] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.117348] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c8499d-aae2-4bde-bb75-7af47bc6d745 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.117348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.117348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.117658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.117758] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c8499d-aae2-4bde-bb75-7af47bc6d745',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.273051] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.622079] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.622079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.622079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.622079] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8c8499d-aae2-4bde-bb75-7af47bc6d745 with status ACTIVE [ 816.622079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.622558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.622558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.622558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.622558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.622690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.622820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.622881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.630022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.630022] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8c8499d-aae2-4bde-bb75-7af47bc6d745 is going to be updated. [ 816.655045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.655045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.655045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.655045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.655045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.655045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c8499d-aae2-4bde-bb75-7af47bc6d745" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.776027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.909305] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: SUCCESS [ 816.909518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.911982] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.911982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.911982] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.122518] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.278195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.278394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.278440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.278858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.278858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.278971] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 817.312619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.312788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.312872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.313115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.313282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.322787] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 817.419315] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.419315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.419315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.419315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.419503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.419503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.419503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.419695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.419733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.419850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.419985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.420132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.420132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.420248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.420378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.420473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.420526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.420661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.420731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.420806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.420890] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.624970] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.625259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.625333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.625606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.625751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.625847] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31e5352-a147-470a-ab00-4f2c60273287 is going to be created. [ 817.708351] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.708627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.708768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.709135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.709395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.733888] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: UNINITIALIZED for 2s [ 817.924619] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5: rpc.has_security_group_logging(os_id): False [ 817.957109] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.957401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.957401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.957576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.957642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.957968] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.958429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.958637] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.958997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.959225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.959370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.959370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.959490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.959565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.959665] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 is going to be created. [ 818.097024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.097214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.097274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.097514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.097790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.120063] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: IN_PROGRESS for 2s [ 819.338594] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 819.339843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.756810] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: SUCCESS [ 819.757108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.757296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.757625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.757840] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.757977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.758063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.758259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.758372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.758484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.758589] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.062433] env[65319]: INFO networking_nsxv3.common.synchronization [req-a05b5a3c-5d20-4176-bb62-2b4dbf43e5c5 req-2762f540-4b61-4ac0-9511-698ea49769f3 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 820.062716] env[65319]: INFO networking_nsxv3.common.synchronization [req-a05b5a3c-5d20-4176-bb62-2b4dbf43e5c5 req-2762f540-4b61-4ac0-9511-698ea49769f3 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 820.063443] env[65319]: INFO networking_nsxv3.common.synchronization [req-a05b5a3c-5d20-4176-bb62-2b4dbf43e5c5 req-2762f540-4b61-4ac0-9511-698ea49769f3 tempest-SecurityGroupsTestJSON-595592974 tempest-SecurityGroupsTestJSON-595592974-project-member] Enqueued Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 820.066025] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGHEST for action security_group_members [ 820.066025] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGHEST for action security_group_members [ 820.066025] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGHEST for action security_group_members [ 820.066025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.066025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.066545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.066939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.067210] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.067365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.067464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.067828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.068887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.068887] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.069718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.069718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.069718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.069718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.070024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.070024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.070024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.070530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.071590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.071590] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.072213] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.072353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.072962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.073275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.073381] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.073463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.074723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.074723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.074723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.074723] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.134370] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: SUCCESS [ 820.134370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.263216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.263682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.263820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.264247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.264574] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.264770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.264928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.265182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.265275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.265642] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.265811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.265890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.266205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.266470] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.266705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.266969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.267241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.267405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.267943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.267943] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.576857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.577560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.577560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.577560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.577880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.577936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.578064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.578161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.578372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.578504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.578666] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be updated. [ 820.579883] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.580036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.580131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.580243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.581517] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.581671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.623625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.624575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.624575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.624575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.624855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.625126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.625250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be updated. [ 820.627346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.627674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.637125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.637419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.637547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.637908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.638261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.653999] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: IN_PROGRESS for 2s [ 820.665435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.665947] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.666192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.666288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.666673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.666825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.666931] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c is going to be updated. [ 820.669959] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.670219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.670291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.670573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.670791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.683699] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: IN_PROGRESS for 2s [ 820.768656] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.769046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.769046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.769441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.769581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.771287] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31e5352-a147-470a-ab00-4f2c60273287: rpc.has_security_group_logging(os_id): False [ 820.796896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: IN_PROGRESS for 2s [ 820.831335] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.831335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.831335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.831897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.831897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.832019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.832105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.832216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.832509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.832692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.832922] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.833077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.833192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.833344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.833459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.833852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.834086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.834188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.834530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.834650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.834735] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31e5352-a147-470a-ab00-4f2c60273287 is going to be created. [ 821.064988] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.065242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.065348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.065674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.065954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.082053] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: IN_PROGRESS for 2s [ 821.763952] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.764356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.764356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.764607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.764759] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.267590] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.665432] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 in Status: SUCCESS [ 822.665702] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 deletion is rescheduled due to dependency. [ 822.665900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.708877] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c in Status: SUCCESS [ 822.709639] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c deletion is rescheduled due to dependency. [ 822.709639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.770119] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.809685] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c in Status: SUCCESS [ 822.810021] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c deletion is rescheduled due to dependency. [ 822.810213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.102628] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: SUCCESS [ 823.102913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.273997] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 823.274227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 824.392157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.392157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.392157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.392157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.408431] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 824.409399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.410692] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 824.444654] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.444654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.444826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.444979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.452744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.453427] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 824.453519] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.453664] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 824.503095] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.503095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.503095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.503434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.505330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.505655] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 824.580636] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.580992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.580992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.581145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.581310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.581532] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 824.683065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.683304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.683355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.683660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.683922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.684424] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 824.684598] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ffe73d27-cd4d-4ef2-a753-b8b05d2db48d', '30580859-8cff-47d8-a383-cb85009ec257', '196d2ce6-1e48-4442-a132-6f23fe6096ff', 'f8289f43-cccf-41f3-8768-9719094a27c3', 'd3fa756c-984c-4373-aa5f-0c3702edf82e', '227caa4e-22f8-4b1d-a23b-fe01278d6b18', '6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b', '7c15410b-c953-4795-bf47-b964e640b74b', '212b5fb1-e89d-45a0-bc24-507876349ec6', '78252624-98d5-4868-98b5-8ddc06e222b7', '0cf2c772-0853-4cb7-a4c6-e787b2cc6bea', '31328668-cad5-4bcc-9c72-54d3bf9877fe', '6b16325f-81df-4dc5-a284-76b424ad674b', 'b31e5352-a147-470a-ab00-4f2c60273287', '2ae5c7f9-eda7-4d97-81d8-bd1295951c2c', 'b4d9e57b-7b71-46dd-8bbf-e08a483c33e6', 'e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7', '3f60b841-0425-4faa-84ee-69be80917aa4', '21b6477e-560e-44cf-bf38-d612f918ff7e', 'e5b6be49-7325-4aa1-a882-59916b0da354', '7a8cfb58-c5d8-4371-a4d8-cce23cb883e5', '848d35f9-8739-4545-aabc-ff592d03c0e0', '08b741bf-ee28-4b27-bf6a-78bf52eb3be6', '53a1e5a3-4b59-400c-b2d3-35a9514b015c', '6058afe7-0c04-438a-8ff7-fa0b65021981', 'dadc0194-ac9d-406b-a9c6-ec6492e3d268', '746f1312-5d40-4fc8-b702-cb8a17f5faa8', 'd51d74c1-0bc9-4f08-9e69-0f36720ce33b', '73bd0d96-c37a-417f-a9ec-9f3f59a6889c', '7803898b-69e4-4d33-860f-8dbb01043ade', '658fe8b2-be4c-42fb-841e-f105abeb65cc', '5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0', '23e179a6-db4e-4e51-ab65-7ae45a30f94e', 'f0e2a77d-4c21-497a-85f5-76d08cf9878e', '2fb71eb3-0fda-4e33-ae51-390153750f63', '64c67b2e-cc70-45f4-b07c-aa5250deaa33', '2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa', 'a1c365c2-b0da-43cf-8088-9c38fa4c5ec9', '1e81f5f5-3357-4ba5-96ae-679bd5c9617f'} {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.684711] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 824.710140] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.710396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.710483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.710667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.710732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.710850] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 824.710919] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.710990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 824.828981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.829242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.829242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.829471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.830308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.830553] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 824.830639] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.830723] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 824.830800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 824.830884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 824.830964] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGH for action security_group_rules [ 824.831061] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGH for action security_group_rules [ 824.831144] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGH for action security_group_rules [ 824.831208] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGH for action security_group_rules [ 824.831270] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGH for action security_group_rules [ 824.831332] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGH for action security_group_rules [ 824.831394] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGH for action security_group_rules [ 824.831468] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGH for action security_group_rules [ 824.831529] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGH for action security_group_rules [ 824.831713] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGH for action security_group_rules [ 824.831713] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGH for action security_group_rules [ 824.831713] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGH for action security_group_rules [ 824.831853] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGH for action security_group_rules [ 824.831853] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGH for action security_group_rules [ 824.831948] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGH for action security_group_rules [ 824.831987] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGH for action security_group_rules [ 824.832061] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGH for action security_group_rules [ 824.832134] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGH for action security_group_rules [ 824.832202] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGH for action security_group_rules [ 824.832265] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGH for action security_group_rules [ 824.832415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.066460] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 825.066689] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 825.066780] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGH for action security_group_rules [ 825.067257] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGH for action security_group_rules [ 825.067466] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGH for action security_group_rules [ 825.067682] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c with Priority: HIGH for action security_group_rules [ 825.067883] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b6be49-7325-4aa1-a882-59916b0da354 with Priority: HIGH for action security_group_rules [ 825.068086] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGH for action security_group_rules [ 825.068254] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f60b841-0425-4faa-84ee-69be80917aa4 with Priority: HIGH for action security_group_rules [ 825.068368] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGH for action security_group_rules [ 825.068523] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGH for action security_group_rules [ 825.068694] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGH for action security_group_rules [ 825.068862] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b16325f-81df-4dc5-a284-76b424ad674b with Priority: HIGH for action security_group_rules [ 825.069015] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGH for action security_group_rules [ 825.069192] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea with Priority: HIGH for action security_group_rules [ 825.069323] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGH for action security_group_rules [ 825.069436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 with Priority: HIGH for action security_group_rules [ 825.069590] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 with Priority: HIGH for action security_group_rules [ 825.069733] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGH for action security_group_rules [ 825.069850] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fa756c-984c-4373-aa5f-0c3702edf82e with Priority: HIGH for action security_group_rules [ 825.069992] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30580859-8cff-47d8-a383-cb85009ec257 with Priority: HIGH for action security_group_rules [ 825.070187] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8289f43-cccf-41f3-8768-9719094a27c3 with Priority: HIGH for action security_group_rules [ 825.070707] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.070790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.070835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.071123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.071218] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.072548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.072718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.072823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.073081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.073173] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.074192] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.074345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.074448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.074741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.074873] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.076366] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.076513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.076629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.076892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.077042] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae5c7f9-eda7-4d97-81d8-bd1295951c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.077931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b6be49-7325-4aa1-a882-59916b0da354 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.078105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.078179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.078386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.078491] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b6be49-7325-4aa1-a882-59916b0da354',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.079742] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.079919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.079919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.080165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.080244] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.081625] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f60b841-0425-4faa-84ee-69be80917aa4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.081625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.081834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.081962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.082096] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f60b841-0425-4faa-84ee-69be80917aa4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.083472] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.083628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.083764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.083929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.084057] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.085382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.085596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.085677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.085866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.085993] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.087179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.087289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.087360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.087533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.087665] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.088938] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b16325f-81df-4dc5-a284-76b424ad674b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.089076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.089076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.089381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.089449] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b16325f-81df-4dc5-a284-76b424ad674b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.089915] env[65319]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 825.090577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.090682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.090788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.091106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.091164] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.092141] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.092265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.092374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.092637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.092738] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cf2c772-0853-4cb7-a4c6-e787b2cc6bea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.093866] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.094076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.094196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.094393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.094472] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.095786] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-212b5fb1-e89d-45a0-bc24-507876349ec6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.095911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.095981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.096165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.096245] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('212b5fb1-e89d-45a0-bc24-507876349ec6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.097148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.097280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.097338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.097528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.097637] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('227caa4e-22f8-4b1d-a23b-fe01278d6b18',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.098526] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.098668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.098735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.098903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.098984] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.100025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3fa756c-984c-4373-aa5f-0c3702edf82e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.100210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.100210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.100509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.100581] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3fa756c-984c-4373-aa5f-0c3702edf82e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.101478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30580859-8cff-47d8-a383-cb85009ec257 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.101582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.101657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.101814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.101882] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30580859-8cff-47d8-a383-cb85009ec257',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.102858] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8289f43-cccf-41f3-8768-9719094a27c3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.102992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.103051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.103183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.103256] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8289f43-cccf-41f3-8768-9719094a27c3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.107119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.107275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.107534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.107695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.107797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.107999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.108097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.108183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.108264] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.110994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.111297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.111484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.112305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.112305] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.112305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.112305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.112305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.112670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.112670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.112670] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.140852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.141047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.141119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.141342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.163336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.163336] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae5c7f9-eda7-4d97-81d8-bd1295951c2c is going to be deleted. [ 825.229725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.229867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.230060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.230222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.230323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.230431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae5c7f9-eda7-4d97-81d8-bd1295951c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.605602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.606106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.606106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.606106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.606242] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.606337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.606390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.606531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.606629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.606718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.606818] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.617449] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.617685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.617788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.618088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.618278] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.618386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.618532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.618713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.618803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.619360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.619488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.619569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.619664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.619890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.620153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.620268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.620326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.620495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.620606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.620775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.620870] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.621928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.622088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.622088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.622260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.622549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.622716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.622947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.623209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.623333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.623475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.623717] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.623866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.623969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.624223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.624347] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.624435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.624558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.624898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.624898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.624898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.625016] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.639582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.639735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.639827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.640057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.640223] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.640324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.640444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.640614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.640734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.640864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.640949] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.642091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.642258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.642360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.642545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.644212] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.644212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.644212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.644212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.644212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.644212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.644212] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.648681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.648681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.648681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.648681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.648681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.648681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.648681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.649140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.649140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.649140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.649140] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.650071] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.650185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.650247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.650408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.650560] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.650658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.650721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.650863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.650947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.651047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.651153] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.652301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.652622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.652622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.652622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.652957] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.652957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.652957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.653104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.653150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.653226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.653393] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.661309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.661515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.661515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.661725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.661893] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.662079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.662183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.662500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.662500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.662500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.662841] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.671824] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.728039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.728365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.728365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.728603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.730996] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.731228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.732352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.732527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.733491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.733606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.734548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.734548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.735317] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.735431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.736080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.736202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.737513] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.737604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.738342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.738434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.739162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.739267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.766580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.766794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be deleted. [ 825.767818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.768050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.795448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.795643] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 227caa4e-22f8-4b1d-a23b-fe01278d6b18 is going to be deleted. [ 825.796637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.796865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.828398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.828581] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cf2c772-0853-4cb7-a4c6-e787b2cc6bea is going to be deleted. [ 825.829516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.829739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.850518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.850747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.863019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.863219] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30580859-8cff-47d8-a383-cb85009ec257 is going to be deleted. [ 825.864418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.864768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.892379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.892689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.914087] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.914256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.919184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.919337] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 212b5fb1-e89d-45a0-bc24-507876349ec6 is going to be deleted. [ 825.920270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.920501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.955301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.955513] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3fa756c-984c-4373-aa5f-0c3702edf82e is going to be deleted. [ 825.956563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.956781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.014935] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.015261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.044036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.044036] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8289f43-cccf-41f3-8768-9719094a27c3 is going to be deleted. [ 826.044804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.045040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.109312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.109712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.109712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.110044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.110296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.110461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.110579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.110810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.110949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.111116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.111353] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.111494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.111604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.111814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.112797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.112797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.112797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.112797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.112797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.113044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.113044] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.114795] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.114943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.128968] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffe73d27-cd4d-4ef2-a753-b8b05d2db48d: rpc.has_security_group_logging(os_id): False [ 826.130571] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b: rpc.has_security_group_logging(os_id): False [ 826.139680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.139964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f60b841-0425-4faa-84ee-69be80917aa4 is going to be deleted. [ 826.141279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.141584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.146305] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.146492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.146540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.146710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.147425] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.147425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.147425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.147425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.147425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.147425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.147779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.147779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.147779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.147779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.147928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.148031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.148097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.148237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.148315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.148471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.148538] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.166347] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.166586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.166586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.166770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.166936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.167047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.167110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.167266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.167353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.167444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.167624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.167729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.167791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.167936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.168089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.168182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.168244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.168383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.168461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168632] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.170167] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.170279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.170348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.170532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.170682] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.170779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.170844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.170984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.171079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.171164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.171308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.171402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.171462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.171619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.171730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.171823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.171885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.172030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.172107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.172187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.172277] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.173384] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.175644] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.175805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.175805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.176035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.176173] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.176269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.176323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.176467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.176548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.176634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.176784] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.176880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.176974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.177080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.177246] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.177343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.177405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.177542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.177620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.177701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.177786] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.179557] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d9e57b-7b71-46dd-8bbf-e08a483c33e6: rpc.has_security_group_logging(os_id): False [ 826.229582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.229582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.236493] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.236716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.254077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.254259] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b16325f-81df-4dc5-a284-76b424ad674b is going to be deleted. [ 826.255265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.255497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.280734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.281074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.308806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.308993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.309946] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.310136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.336261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.336499] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b6be49-7325-4aa1-a882-59916b0da354 is going to be deleted. [ 826.337629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.337894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.337979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.338121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.338323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.338504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.338626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.338755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-227caa4e-22f8-4b1d-a23b-fe01278d6b18" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.339375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.339887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.340122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.340335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cf2c772-0853-4cb7-a4c6-e787b2cc6bea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.340603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.340856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.341027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.341219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30580859-8cff-47d8-a383-cb85009ec257" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.341440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.341710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.341878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.342120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-212b5fb1-e89d-45a0-bc24-507876349ec6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.342326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.342583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.357241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.357489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.430222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.430541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.430681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.430749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.430988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.431117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.431323] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.431440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.431516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.431698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.431774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.431971] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.432082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.432143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.432312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.432451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.432592] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 826.433779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.433990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.493517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.493767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.493996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.493996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.494188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.494259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.494458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.494681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.494681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.494829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.494915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.495122] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.495261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.495261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.495415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.495520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.495671] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 826.496827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.497041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.497151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.497290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8289f43-cccf-41f3-8768-9719094a27c3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.497455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.497606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.497690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.497818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3fa756c-984c-4373-aa5f-0c3702edf82e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.497984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.498182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.498269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.498378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f60b841-0425-4faa-84ee-69be80917aa4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.498513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.498658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.501996] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.502180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.526411] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.526702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.593430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.593848] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.593994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.594128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.594374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.594464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.594591] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be updated. [ 826.595807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.595997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.596146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.596227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b16325f-81df-4dc5-a284-76b424ad674b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.596372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.596528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.596609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.596724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b6be49-7325-4aa1-a882-59916b0da354" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.616720] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 196d2ce6-1e48-4442-a132-6f23fe6096ff: rpc.has_security_group_logging(os_id): False [ 826.621259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.621492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.621492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.622041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.622216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.649616] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 826.651037] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31328668-cad5-4bcc-9c72-54d3bf9877fe: rpc.has_security_group_logging(os_id): False [ 826.670996] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31e5352-a147-470a-ab00-4f2c60273287: rpc.has_security_group_logging(os_id): False [ 826.679322] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21b6477e-560e-44cf-bf38-d612f918ff7e: rpc.has_security_group_logging(os_id): False [ 826.680777] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78252624-98d5-4868-98b5-8ddc06e222b7: rpc.has_security_group_logging(os_id): False [ 826.681980] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c15410b-c953-4795-bf47-b964e640b74b: rpc.has_security_group_logging(os_id): False [ 826.704666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.704923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.704923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.705169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.710879] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.711079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.716288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.716476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.735474] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.735474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.736580] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.736762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.745582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.745582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.762771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.762771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.796413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.796691] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.796867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.796975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.797315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.797315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.797428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.797484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.797550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.797680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.797756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.797945] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.798038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.798100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.798243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.798313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.798411] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 826.799555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.799727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.808136] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.808294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.841451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.841766] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.841906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.841977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.842200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.842285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.842505] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.842606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.842672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.842840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.842921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.843129] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.843234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.843311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.843458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.843537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.843711] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 826.845771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.846123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.953226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.953536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.953669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.953738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.953957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.954055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.954255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.954363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.954426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.954644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.954719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.954982] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.955136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.955184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.955316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.955393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.955492] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 826.957707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.957930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.958062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.959233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.959314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.968608] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.968781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.042433] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 827.052046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.052046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.052046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.052046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.052327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.052364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.052470] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 is going to be updated. [ 827.053728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.053962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.054137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.055257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.055480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.094261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.094563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.135301] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: IN_PROGRESS for 2s [ 827.139524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.139994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.140230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.140332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.140579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.140675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.140940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.141090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.141206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.141430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.141554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.141801] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.141894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.141958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.142135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.142217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.142319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 827.143767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.144030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.144277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.145752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.145951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.180311] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 827.239117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.239478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.239988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.239988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.239988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.239988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.240260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.240393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.240473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.240579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.240650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.240962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.240962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.241181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.241181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.241246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.241327] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31e5352-a147-470a-ab00-4f2c60273287 is going to be updated. [ 827.243445] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.243684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.243684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.243959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.243996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.245271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.245820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.245820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.269659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.269986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.270079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.270363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.270573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.284198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 827.288675] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 827.306319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: IN_PROGRESS for 2s [ 827.383374] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.383494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.383568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.383801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.383977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.419459] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 827.480172] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.480331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.480448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.480757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.480920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.559297] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: IN_PROGRESS for 2s [ 827.819537] env[65319]: INFO networking_nsxv3.common.synchronization [req-49f98679-5602-432c-8ecf-e0b9bd40c07d req-fd379ac7-d521-4ae1-810c-cbf78b87d7f2 tempest-ServersTestJSON-514632879 tempest-ServersTestJSON-514632879-project-member] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 827.820451] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 827.820964] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.820964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.820964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.820964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.821435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.821911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.821911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.821911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.821911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.822111] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.318611] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.318961] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-504" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.318961] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-504" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.319277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-504" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.319582] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.319740] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.319904] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.320298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.320298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.320465] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.320524] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.320635] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.320792] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.320976] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.320976] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.321107] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.325181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.325348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.325416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.325646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.325805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.326017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.326149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.326208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.326318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.326385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.327049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad already deleted. [ 828.327049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.342590] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.342793] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.343069] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.343216] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-504" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.343558] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-1e860d30-c251-4465-b72c-62bee979a4b2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.343853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.343853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.344286] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.344449] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e860d30-c251-4465-b72c-62bee979a4b2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.664089] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 828.664345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847275] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.847674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.847817] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.848796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.849080] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.849341] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 1e860d30-c251-4465-b72c-62bee979a4b2 not found, creating... [ 828.849757] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.850029] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.850221] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.850482] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.850625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.851014] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.851280] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.851481] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.851809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.852045] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.852292] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 1e860d30-c251-4465-b72c-62bee979a4b2 is going to be created. [ 828.876482] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.876708] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.876840] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.877142] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.877359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.877590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.057988] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 829.058285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.149564] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 829.149915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.196229] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 829.196493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.323995] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 829.324305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.325244] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 829.325451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.352912] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: SUCCESS [ 829.353362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.435528] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 829.435713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.573643] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: SUCCESS [ 829.574423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.657058] env[65319]: INFO networking_nsxv3.common.synchronization [req-49f98679-5602-432c-8ecf-e0b9bd40c07d req-7969735b-0022-4135-99d7-06ad70f31db5 service nova] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 829.657188] env[65319]: INFO networking_nsxv3.common.synchronization [req-49f98679-5602-432c-8ecf-e0b9bd40c07d req-7969735b-0022-4135-99d7-06ad70f31db5 service nova] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 829.657327] env[65319]: INFO networking_nsxv3.common.synchronization [req-49f98679-5602-432c-8ecf-e0b9bd40c07d req-7969735b-0022-4135-99d7-06ad70f31db5 service nova] Enqueued Resource ID: 1e860d30-c251-4465-b72c-62bee979a4b2 with Priority: HIGHEST for action port [ 829.657938] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_rules [ 829.658682] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 829.658783] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e860d30-c251-4465-b72c-62bee979a4b2 with Priority: HIGHEST for action port [ 829.659287] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.659719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.659785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.659974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.660129] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.661811] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.661887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.661887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.662386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.663209] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.663371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.663441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.663620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.663812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.663947] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.664939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e860d30-c251-4465-b72c-62bee979a4b2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.665678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.665678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.665855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.665906] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e860d30-c251-4465-b72c-62bee979a4b2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.168510] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e860d30-c251-4465-b72c-62bee979a4b2 with status ACTIVE [ 830.169517] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.169761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.169843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.170094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.170213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.170427] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.170539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.170606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.170786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.170886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.171091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.171192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.171259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.171397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.171471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.171698] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e860d30-c251-4465-b72c-62bee979a4b2 is going to be updated. [ 830.172819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.172952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.173127] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.200031] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.200539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.204029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.204029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.204029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.204029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e860d30-c251-4465-b72c-62bee979a4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.552338] env[65319]: INFO networking_nsxv3.common.synchronization [req-2cc5055b-eff7-40ac-8d42-e5ac6b8de7f3 req-69c4c934-a135-42b2-a9dd-7a23c7a9f50b tempest-ServerRescueTestJSON-74048994 tempest-ServerRescueTestJSON-74048994-project-member] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 830.553108] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 830.554595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.554595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.554595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.554595] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.671365] env[65319]: INFO networking_nsxv3.common.synchronization [req-3c7fb780-6411-459b-ab2a-43f2f3ae66ff req-e8935049-4ea3-4676-92bc-520e18ab5118 tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 830.671365] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 830.671365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.671365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.671365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.671365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.671365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.671365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.671365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.671808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.671808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.671808] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.682325] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.992065] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.992358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.992506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.992856] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.993361] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.993610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.993765] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.995273] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.995432] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.996062] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.996062] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.996062] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.996569] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.996569] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.996569] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.996569] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.017499] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.017654] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.017851] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.018059] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.018407] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-da6b2b0a-37d3-4b2e-8853-67bfa951516a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.018608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.018815] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.019225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.019867] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da6b2b0a-37d3-4b2e-8853-67bfa951516a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.057219] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.057373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.057447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.057765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.057857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.058101] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.058245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.058333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.058510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.058599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.058702] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc already deleted. [ 831.058819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.176259] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.185891] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.186112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.186162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.186352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.186441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.186541] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad is going to be created. [ 831.220265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.220502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.220502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.220716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.220884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.233486] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: UNINITIALIZED for 2s [ 831.522432] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.522651] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.522783] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.523090] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.523234] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.523380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port da6b2b0a-37d3-4b2e-8853-67bfa951516a not found, creating... [ 831.523649] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.524346] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.524346] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.524346] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.524346] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.524674] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.524737] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.524844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.525200] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.525283] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.525456] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: da6b2b0a-37d3-4b2e-8853-67bfa951516a is going to be created. [ 831.548786] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.548947] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.549655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.549655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.549655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.549855] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.679145] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.077932] env[65319]: INFO networking_nsxv3.common.synchronization [None req-cdd8f56d-8f1b-41da-a242-f5478f3e4f84 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 832.078615] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 832.079117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.079117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.079273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.079450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.079537] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.183379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.183791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.183791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.184313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.184616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.184825] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 832.221179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.221179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.221179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.221179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.221179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.234050] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 832.341131] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c40ce473-408d-4d9a-91e2-632246006f70 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 832.341924] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 832.342600] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.342741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.401641] env[65319]: INFO networking_nsxv3.common.synchronization [req-2cc5055b-eff7-40ac-8d42-e5ac6b8de7f3 req-b2a3c86e-357e-48c7-bacf-87a4c9a56519 service nova] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_rules [ 832.401911] env[65319]: INFO networking_nsxv3.common.synchronization [req-2cc5055b-eff7-40ac-8d42-e5ac6b8de7f3 req-b2a3c86e-357e-48c7-bacf-87a4c9a56519 service nova] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 832.402393] env[65319]: INFO networking_nsxv3.common.synchronization [req-2cc5055b-eff7-40ac-8d42-e5ac6b8de7f3 req-b2a3c86e-357e-48c7-bacf-87a4c9a56519 service nova] Enqueued Resource ID: da6b2b0a-37d3-4b2e-8853-67bfa951516a with Priority: HIGHEST for action port [ 832.403034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_rules [ 832.403034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 832.403034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6b2b0a-37d3-4b2e-8853-67bfa951516a with Priority: HIGHEST for action port [ 832.403661] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.403853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.403947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.404380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.405336] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.407218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.408133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.408705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.411777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.411777] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.411777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-da6b2b0a-37d3-4b2e-8853-67bfa951516a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.411777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.412241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.412241] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da6b2b0a-37d3-4b2e-8853-67bfa951516a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.603790] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.603790] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 already deleted. [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.603790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.604280] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.909907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.909907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.914357] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.917145] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da6b2b0a-37d3-4b2e-8853-67bfa951516a with status ACTIVE [ 832.918375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.918750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.920371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.921466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.921466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.921466] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.921466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.921466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.921718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.921718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.921979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.922141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.922235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.922422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.922546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.922676] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da6b2b0a-37d3-4b2e-8853-67bfa951516a is going to be updated. [ 832.954824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.954824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.954824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.955129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.955129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da6b2b0a-37d3-4b2e-8853-67bfa951516a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.134122] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.134277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.134336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.135035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.135035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.135035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 already deleted. [ 833.135035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.259029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: SUCCESS [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.259029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.259029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.259029] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.426557] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.498465] env[65319]: INFO networking_nsxv3.common.synchronization [req-992f6655-ef8d-46dc-a61b-18e3e699db87 req-0f32c3b7-ed68-41b0-a345-8a29804dfebb tempest-InstanceActionsV221TestJSON-1568642525 tempest-InstanceActionsV221TestJSON-1568642525-project-member] Enqueued Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 833.499500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 833.499500] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.499752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.499752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.499974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.500187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.500352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.500437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.500638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.500736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.500845] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.761042] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.929409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.930029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.930029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.930029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.930029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.930220] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be created. [ 833.962304] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.962474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.962474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.962920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.963174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.979345] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: UNINITIALIZED for 2s [ 833.992976] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.993104] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-608" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.993815] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-608" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.993815] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-608" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.993815] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.994118] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.994218] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.994444] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.994668] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.994942] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.995068] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.995193] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.995302] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.995411] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.995532] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.995686] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.003894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.003894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.003894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.004108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.004211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.004448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.004631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.004695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.004883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.004965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.005150] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b already deleted. [ 834.005244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.026064] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.026064] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.026434] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.026434] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-608" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.026682] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-3d058383-0e5c-47c1-80ac-d5047947bd72 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.026973] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.026973] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.027321] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.027462] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d058383-0e5c-47c1-80ac-d5047947bd72',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.246931] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 834.247319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.263372] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b3ae0b8-2b6a-4047-910f-6c73004e35ad: rpc.has_security_group_logging(os_id): False [ 834.270288] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f67e7f60-0870-483a-824f-7e357f22a5a7 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 834.271429] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 834.271771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.271934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.271996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.272329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.272452] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.293094] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.293278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.293318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.293519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.293606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.293845] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.293944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.294025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.294173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.294249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.294338] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad is going to be created. [ 834.362619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.362781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.362870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.363188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.363476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.373960] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: IN_PROGRESS for 2s [ 834.445669] env[65319]: INFO networking_nsxv3.common.synchronization [None req-9142841b-d5bb-42c8-87c9-8a0916050f2b tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 834.446345] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 834.446686] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.446804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.530733] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.531175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.531398] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.531873] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.532163] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.532438] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 3d058383-0e5c-47c1-80ac-d5047947bd72 not found, creating... [ 834.532970] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.533345] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.533600] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.534052] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.534919] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.535338] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.535627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.535727] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.536277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.536277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.536569] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 3d058383-0e5c-47c1-80ac-d5047947bd72 is going to be created. [ 834.561764] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.562017] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.562148] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.562554] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.562821] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.563089] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.814828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.814828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.814828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.815173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.815173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.815173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6c793-0760-435d-be82-33d755948f79 already deleted. [ 834.815320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.815506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.815710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.815826] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.355069] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.356035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.356035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.356035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.356762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.358504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6c793-0760-435d-be82-33d755948f79 already deleted. [ 835.358504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.372041] env[65319]: INFO networking_nsxv3.common.synchronization [req-992f6655-ef8d-46dc-a61b-18e3e699db87 req-63b6ba5a-5343-402c-bb0d-69bd2b18eefa service nova] Enqueued Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_rules [ 835.373232] env[65319]: INFO networking_nsxv3.common.synchronization [req-992f6655-ef8d-46dc-a61b-18e3e699db87 req-63b6ba5a-5343-402c-bb0d-69bd2b18eefa service nova] Enqueued Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 835.373232] env[65319]: INFO networking_nsxv3.common.synchronization [req-992f6655-ef8d-46dc-a61b-18e3e699db87 req-63b6ba5a-5343-402c-bb0d-69bd2b18eefa service nova] Enqueued Resource ID: 3d058383-0e5c-47c1-80ac-d5047947bd72 with Priority: HIGHEST for action port [ 835.375982] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_rules [ 835.376989] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 835.376989] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d058383-0e5c-47c1-80ac-d5047947bd72 with Priority: HIGHEST for action port [ 835.379008] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.379008] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.379008] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.379008] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.379008] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.380997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.380997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.380997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.381308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.382049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.382049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.382049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.382260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.382589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.382589] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.390512] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d058383-0e5c-47c1-80ac-d5047947bd72 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.390777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.390888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.392215] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d058383-0e5c-47c1-80ac-d5047947bd72',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.564820] env[65319]: INFO networking_nsxv3.common.synchronization [req-637e4020-26ee-4ad2-9524-9080187fedf2 req-5c988a1e-293e-46de-8839-fcdfce8f86e7 tempest-AttachInterfacesV270Test-859276709 tempest-AttachInterfacesV270Test-859276709-project-member] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 835.565757] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGHEST for action security_group_members [ 835.566186] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.566349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.566443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.566686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.568783] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.568783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.568783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.568783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.568783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.568783] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.894518] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.895913] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.896273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.896491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d058383-0e5c-47c1-80ac-d5047947bd72 with status ACTIVE [ 835.896681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.896844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.896913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.897237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.897349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.897554] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.898029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.898029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.898380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.898519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.898798] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.899025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.899234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.899603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.899732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.899894] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d058383-0e5c-47c1-80ac-d5047947bd72 is going to be updated. [ 835.928690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.928867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.929137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.929290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.929470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.929655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d058383-0e5c-47c1-80ac-d5047947bd72" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.998134] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.998134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.998134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.998134] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.070894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.071562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.071673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.073590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.073590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.073590] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31e5352-a147-470a-ab00-4f2c60273287 is going to be updated. [ 836.110176] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.111191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.111191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.111191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.111191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.125329] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: IN_PROGRESS for 2s [ 836.389614] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: SUCCESS [ 836.389614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.397370] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.468682] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a5da5df-2cd5-4cfb-81b6-c51853911f26 req-f0cb8631-4ea8-4394-8854-cc817908e618 tempest-ServersAdminNegativeTestJSON-701324115 tempest-ServersAdminNegativeTestJSON-701324115-project-member] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 836.469528] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 836.470339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.470598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.470662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.470841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.471039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.471143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.471512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.471512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.471706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.471706] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.500923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.501117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.501163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.501372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.501541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.501644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.501706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.501850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.501981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.502099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.502255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.502351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.502413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.502732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.502955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.503082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.503152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.503295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.503376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.503463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.503565] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.900429] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.900788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.900788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.901054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.901054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.901183] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b is going to be created. [ 836.962917] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.965381] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.965381] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.966362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.966619] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.966798] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.967051] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.967219] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.967403] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.967565] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.967771] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.972365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.972365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.972365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.972672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.972950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.976560] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.993736] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: UNINITIALIZED for 2s [ 837.003431] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.003698] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.003904] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.004151] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.004601] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.004834] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.004960] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.005331] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.005466] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ae46dee-3439-4b60-bf42-0bc6ddc964d0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.006986] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49a2be0-948f-4d73-a2fe-ec8e39d28abc: rpc.has_security_group_logging(os_id): False [ 837.060953] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.061246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.061500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.061697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.061860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.062219] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.062466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.062531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.063414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.063827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.067028] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.067028] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.067028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.067028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be created. [ 837.211480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.212346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.212346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.212346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.212346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.231164] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 837.482247] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.511410] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.511561] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.511668] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.512219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.512219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.512398] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 not found, creating... [ 837.512906] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.513073] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.513115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.513391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.513609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.514081] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.514256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.514409] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.514743] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.514883] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.515094] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 is going to be created. [ 837.542125] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.542358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.542637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.542941] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.543186] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.543412] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.984460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.984693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.984781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.984985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.985093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.985194] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 838.021109] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.021255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.022018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.022018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.022018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.033145] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 838.140190] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31e5352-a147-470a-ab00-4f2c60273287 in Status: SUCCESS [ 838.143032] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31e5352-a147-470a-ab00-4f2c60273287 deletion is rescheduled due to dependency. [ 838.143032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.421374] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a5da5df-2cd5-4cfb-81b6-c51853911f26 req-d23f7049-d599-47ef-adc6-0907caa46a54 service nova] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_rules [ 838.421608] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a5da5df-2cd5-4cfb-81b6-c51853911f26 req-d23f7049-d599-47ef-adc6-0907caa46a54 service nova] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 838.421792] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a5da5df-2cd5-4cfb-81b6-c51853911f26 req-d23f7049-d599-47ef-adc6-0907caa46a54 service nova] Enqueued Resource ID: 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 with Priority: HIGHEST for action port [ 838.422396] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_rules [ 838.422519] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 838.422616] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 with Priority: HIGHEST for action port [ 838.422992] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.423163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.423249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.423529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.423654] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.424789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.424939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.425253] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.425421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.425532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.425800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.425910] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ae46dee-3439-4b60-bf42-0bc6ddc964d0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.930586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.930586] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 with status ACTIVE [ 838.930586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.930586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.930586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.930586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.931558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.931558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.931558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.931558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.931558] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ae46dee-3439-4b60-bf42-0bc6ddc964d0 is going to be updated. [ 838.956584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.956783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.956783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.957028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.957163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.957324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ae46dee-3439-4b60-bf42-0bc6ddc964d0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.005073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: SUCCESS [ 839.005355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.006097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.006097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.006097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.006386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.006386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.006386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.006567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.006567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.007297] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.251958] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 839.252741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.509245] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.509245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.509462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.513022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.513022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.513022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.513841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.513841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.513841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.513841] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.016275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a329f993-c39f-4fa0-aa69-6368abd88e7b: rpc.has_security_group_logging(os_id): False [ 840.040346] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.040554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.040605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.040814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.040967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.041394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.041472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.041528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.041766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.041903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.042375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.042550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.042858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.042858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.043079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.045048] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.045048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.045048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.045048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.045048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.045048] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b is going to be created. [ 840.047503] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 840.047700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.049668] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.049668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.049668] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.149233] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.149233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.149233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.149233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.149233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.171135] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: IN_PROGRESS for 2s [ 840.556015] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.061364] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.567470] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.567617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.567687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.567911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.567998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.568108] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 841.600687] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.600925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.600925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.601116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.601241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.616342] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 841.733653] env[65319]: INFO networking_nsxv3.common.synchronization [req-aefaedee-279a-40ff-a70c-6bf690d1aa9b req-1cf78f59-9c3d-486b-961b-cc6910a8f9da tempest-InstanceActionsTestJSON-2126032322 tempest-InstanceActionsTestJSON-2126032322-project-member] Enqueued Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 841.733653] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGHEST for action security_group_members [ 841.733834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.733900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.733939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.734646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.734646] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.734646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.734646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.734646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.734969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.734969] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.193364] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: SUCCESS [ 842.193780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.238408] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.238870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.239117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.239510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.265746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.266097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.266235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.266315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.266548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.266675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.266786] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 is going to be updated. [ 842.309942] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.309942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.310213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.310253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.310391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.323088] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: IN_PROGRESS for 2s [ 843.625866] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 843.626217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.626261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.626463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.626650] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.626768] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.626859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.627087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.627170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.627297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.627339] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.130523] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.130691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.130798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131991] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.132196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.132196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.132355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.132468] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.132612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.132681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.132872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.133020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.133098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.133419] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.334052] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 in Status: SUCCESS [ 844.334258] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 deletion is rescheduled due to dependency. [ 844.334373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.639921] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 196d2ce6-1e48-4442-a132-6f23fe6096ff: rpc.has_security_group_logging(os_id): False [ 844.667218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.667427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.667701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.667999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.667999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.668303] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.668428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.668428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.668634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.668688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.668890] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.669348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.669348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.669348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.669348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.669843] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.669843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.669933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.670110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.670175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.670226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 844.762027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.762027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.762027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.762027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.762027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.781273] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 844.877182] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3b076f38-4823-43aa-a8e5-f7b89a58e3d0 None None] Enqueued Resource ID: a0ebd60f-c997-4f65-b478-c1727f01e54a with Priority: HIGHEST for action port [ 844.877767] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ebd60f-c997-4f65-b478-c1727f01e54a with Priority: HIGHEST for action port [ 844.878110] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0ebd60f-c997-4f65-b478-c1727f01e54a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.878255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0ebd60f-c997-4f65-b478-c1727f01e54a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.878364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0ebd60f-c997-4f65-b478-c1727f01e54a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.878594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0ebd60f-c997-4f65-b478-c1727f01e54a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.878681] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0ebd60f-c997-4f65-b478-c1727f01e54a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.393230] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0ebd60f-c997-4f65-b478-c1727f01e54a [ 845.393515] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.393650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.393722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.393939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.394043] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.394143] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0ebd60f-c997-4f65-b478-c1727f01e54a already deleted. [ 845.394227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0ebd60f-c997-4f65-b478-c1727f01e54a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.797058] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 846.797406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.454411] env[65319]: INFO networking_nsxv3.common.synchronization [None req-6625a5ba-5d26-4246-b634-5a29003ac651 None None] Enqueued Resource ID: 09ab9dbc-2d0d-4926-909b-0e0fb95463ca with Priority: HIGHEST for action port [ 847.454983] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ab9dbc-2d0d-4926-909b-0e0fb95463ca with Priority: HIGHEST for action port [ 847.455308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-09ab9dbc-2d0d-4926-909b-0e0fb95463ca taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.455421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09ab9dbc-2d0d-4926-909b-0e0fb95463ca" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.455485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09ab9dbc-2d0d-4926-909b-0e0fb95463ca" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.455739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09ab9dbc-2d0d-4926-909b-0e0fb95463ca" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.455811] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ab9dbc-2d0d-4926-909b-0e0fb95463ca',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.964040] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09ab9dbc-2d0d-4926-909b-0e0fb95463ca [ 847.964040] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.964040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.964040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.964040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.964040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.964040] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09ab9dbc-2d0d-4926-909b-0e0fb95463ca already deleted. [ 847.964040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09ab9dbc-2d0d-4926-909b-0e0fb95463ca" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.103686] env[65319]: INFO networking_nsxv3.common.synchronization [req-d586d11d-1eaf-4d66-8e76-b9c3fa881ac0 req-e2253ffe-48a8-4f1a-9d37-2e9922f89e0f tempest-InstanceActionsV221TestJSON-1568642525 tempest-InstanceActionsV221TestJSON-1568642525-project-member] Enqueued Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 848.104316] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGHEST for action security_group_members [ 848.104686] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.104845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.104903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.105250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.105777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.105777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.105929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.105977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.106085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.106156] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.111720] env[65319]: INFO networking_nsxv3.common.synchronization [req-2341be42-5502-4204-b9d5-8e4f0b22fe6b req-fd9dfa19-77e0-4c75-9248-f90d8159feac tempest-FloatingIPsAssociationTestJSON-2127283809 tempest-FloatingIPsAssociationTestJSON-2127283809-project-member] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 848.116020] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGHEST for action security_group_members [ 848.116020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.116020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.116020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.116020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.609024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.609302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.609302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.609754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.609754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.609925] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.609996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.610044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.610195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.610273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.610360] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b is going to be updated. [ 848.619799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.619957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.620042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.620272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.620360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.620558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.620654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.620723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.620875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.621211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.621211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be updated. [ 848.658912] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.659469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.659717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.664257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.664257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.666187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.666297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.666356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.666674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.666869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.683241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: IN_PROGRESS for 2s [ 848.683241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: IN_PROGRESS for 2s [ 850.696183] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a329f993-c39f-4fa0-aa69-6368abd88e7b in Status: SUCCESS [ 850.696513] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b deletion is rescheduled due to dependency. [ 850.696578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.697482] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c15410b-c953-4795-bf47-b964e640b74b in Status: SUCCESS [ 850.697631] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c15410b-c953-4795-bf47-b964e640b74b deletion is rescheduled due to dependency. [ 850.697720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.819212] env[65319]: INFO networking_nsxv3.common.synchronization [None req-56755876-ac00-4098-91c0-bc950b94cef0 None None] Enqueued Resource ID: aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f with Priority: HIGHEST for action port [ 851.819681] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f with Priority: HIGHEST for action port [ 851.820050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.820192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.820264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.820701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.820701] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.901540] env[65319]: INFO networking_nsxv3.common.synchronization [req-5b05de11-f9e8-4d40-b658-1695ce2724ba req-f79280f2-3e50-41ce-a886-baf38926d815 tempest-ListServerFiltersTestJSON-296923021 tempest-ListServerFiltersTestJSON-296923021-project-member] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 851.902120] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGHEST for action security_group_members [ 851.903258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.903258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.903258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.903258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.903258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.903995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.903995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.903995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.903995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.903995] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.297359] env[65319]: INFO networking_nsxv3.common.synchronization [req-025cbfde-b431-4885-b8f9-a6be1597c24d req-a4a280b6-cc15-44f1-a961-64f58306efbb tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 852.297883] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 852.298216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.298342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.298409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.298604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.299447] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.299575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.299645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.299837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.299924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.300034] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.328549] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f [ 852.328633] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.328714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.328776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.329012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.329097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.329187] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f already deleted. [ 852.329258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aef0c0a7-a32b-486d-a0b8-6af0e40f4c7f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.406882] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.407049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.407127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.407370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.407411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.410217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.410412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.410481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.410934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.410934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.410934] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be updated. [ 852.441336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.441425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.442397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.442397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.442397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.451750] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: IN_PROGRESS for 2s [ 852.755924] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.756297] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.756540] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.756816] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.757131] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.757327] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.757466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.757696] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.757839] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.757956] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.758074] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.758188] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.758292] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.758431] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.804779] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.926263] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.926263] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.167 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.926263] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.926263] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.926729] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-7ed8cd62-301b-451e-9cd0-134d4955967d taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.926894] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.927590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.927921] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.928071] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed8cd62-301b-451e-9cd0-134d4955967d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.308523] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.430610] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.431070] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.431221] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.431738] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.432028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.432259] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 7ed8cd62-301b-451e-9cd0-134d4955967d not found, creating... [ 853.432632] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.432872] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.433199] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.433437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.433576] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.435313] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.435489] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.435613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.435904] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.436057] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.436223] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 7ed8cd62-301b-451e-9cd0-134d4955967d is going to be created. [ 853.459863] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.460176] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.460304] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.460800] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.461072] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.461308] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.485599] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8d915d24-fe4d-479b-9036-6d4b4bad2d29 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 853.485599] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 853.485957] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.486022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.486076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.486348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.486429] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.609952] env[65319]: INFO networking_nsxv3.common.synchronization [None req-6598b721-bf50-4714-a2ae-0f76d779f09d tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 853.610051] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 853.610799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.610986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.812467] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.812467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.812467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.812816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.812816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.812816] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 853.858307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.858632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.858909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.859149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.859261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.870216] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 854.011635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.011963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.011963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.012419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.012554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.012694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f already deleted. [ 854.012829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.013739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.013739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.013739] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.143317] env[65319]: INFO networking_nsxv3.common.synchronization [req-025cbfde-b431-4885-b8f9-a6be1597c24d req-53fab98b-09e1-462d-b572-7afe382b2e84 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 854.143539] env[65319]: INFO networking_nsxv3.common.synchronization [req-025cbfde-b431-4885-b8f9-a6be1597c24d req-53fab98b-09e1-462d-b572-7afe382b2e84 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 854.143698] env[65319]: INFO networking_nsxv3.common.synchronization [req-025cbfde-b431-4885-b8f9-a6be1597c24d req-53fab98b-09e1-462d-b572-7afe382b2e84 service nova] Enqueued Resource ID: 7ed8cd62-301b-451e-9cd0-134d4955967d with Priority: HIGHEST for action port [ 854.144353] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 854.144513] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 854.145015] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed8cd62-301b-451e-9cd0-134d4955967d with Priority: HIGHEST for action port [ 854.145269] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.145435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.145519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.146044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.146089] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.147335] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.147559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.147950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ed8cd62-301b-451e-9cd0-134d4955967d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.148166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.148280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.148619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.148865] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed8cd62-301b-451e-9cd0-134d4955967d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.465301] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b in Status: SUCCESS [ 854.465301] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b deletion is rescheduled due to dependency. [ 854.465819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.539825] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.539987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.540126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.540379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.540472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.540575] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f already deleted. [ 854.540658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.652370] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.652595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.659153] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ed8cd62-301b-451e-9cd0-134d4955967d with status ACTIVE [ 854.659153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.659153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.659153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.659153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.659153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.661143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.661143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.661143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.661611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.661611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.661882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ed8cd62-301b-451e-9cd0-134d4955967d is going to be updated. [ 854.684864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.686632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.686632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.686632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.686849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.686849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ed8cd62-301b-451e-9cd0-134d4955967d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.962853] env[65319]: INFO networking_nsxv3.common.synchronization [None req-b158e9f0-10a2-45f2-a0a6-79d845823d57 None None] Enqueued Resource ID: 8917fee9-61fa-4e71-9e11-bfafae1d868e with Priority: HIGHEST for action port [ 854.963581] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8917fee9-61fa-4e71-9e11-bfafae1d868e with Priority: HIGHEST for action port [ 854.963918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8917fee9-61fa-4e71-9e11-bfafae1d868e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.964072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8917fee9-61fa-4e71-9e11-bfafae1d868e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.964136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8917fee9-61fa-4e71-9e11-bfafae1d868e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.964436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8917fee9-61fa-4e71-9e11-bfafae1d868e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.964517] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8917fee9-61fa-4e71-9e11-bfafae1d868e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.467914] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8917fee9-61fa-4e71-9e11-bfafae1d868e [ 855.468312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.468312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.468312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.468502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.468634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.468780] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8917fee9-61fa-4e71-9e11-bfafae1d868e already deleted. [ 855.468990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8917fee9-61fa-4e71-9e11-bfafae1d868e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.891541] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.891541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.891541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.891541] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.392754] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.451602] env[65319]: INFO networking_nsxv3.common.synchronization [req-f563bac9-227e-4450-91f5-3dc33da86f8d req-94c8c04f-b152-44a6-ae02-b9b974172829 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 856.452481] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 856.452574] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.454233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.454233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.454233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.454233] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.454233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.454743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.454743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.454743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.454743] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.896183] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.896183] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.896183] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.896183] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.896663] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.896663] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.896884] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.897476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.897710] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.898027] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.898179] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.898361] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.898535] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.898719] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.898904] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.899119] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.901699] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.921488] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.921488] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.921488] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.921488] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.921810] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-7042a8f1-40e4-4dad-9351-b502c5d0117c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.922241] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.922241] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.923184] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.923360] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7042a8f1-40e4-4dad-9351-b502c5d0117c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.958549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.958737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.958868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.959120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.960323] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.960323] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 already deleted. [ 856.960323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.404122] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.404411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.404411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.404600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.404706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.404767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 857.428359] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.428732] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.428990] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.429575] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.429794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.430124] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 7042a8f1-40e4-4dad-9351-b502c5d0117c not found, creating... [ 857.430615] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.430900] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.431159] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.431537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.431938] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.432426] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.432721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.432954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.433399] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.433605] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.433895] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 7042a8f1-40e4-4dad-9351-b502c5d0117c is going to be created. [ 857.442827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.442970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.443092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.443357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.443662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.456346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 857.466942] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.467196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.467316] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.467579] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.467786] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.468104] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.250577] env[65319]: INFO networking_nsxv3.common.synchronization [req-f563bac9-227e-4450-91f5-3dc33da86f8d req-85e6c7d1-446b-48d7-ad50-9665cb038a46 service nova] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 858.250923] env[65319]: INFO networking_nsxv3.common.synchronization [req-f563bac9-227e-4450-91f5-3dc33da86f8d req-85e6c7d1-446b-48d7-ad50-9665cb038a46 service nova] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 858.250923] env[65319]: INFO networking_nsxv3.common.synchronization [req-f563bac9-227e-4450-91f5-3dc33da86f8d req-85e6c7d1-446b-48d7-ad50-9665cb038a46 service nova] Enqueued Resource ID: 7042a8f1-40e4-4dad-9351-b502c5d0117c with Priority: HIGHEST for action port [ 858.251508] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_rules [ 858.251619] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 858.251721] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7042a8f1-40e4-4dad-9351-b502c5d0117c with Priority: HIGHEST for action port [ 858.256022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.256022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.256022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.256022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.256022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.256022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.257337] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7042a8f1-40e4-4dad-9351-b502c5d0117c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.257337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.257337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.257337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.257337] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7042a8f1-40e4-4dad-9351-b502c5d0117c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.758873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.759042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.759240] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.761275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7042a8f1-40e4-4dad-9351-b502c5d0117c with status ACTIVE [ 858.761955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.762263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.762422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.762731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.763038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.763263] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.765434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.765434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.765434] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7042a8f1-40e4-4dad-9351-b502c5d0117c is going to be updated. [ 858.799597] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.799817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.799817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.800019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.800159] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.800321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7042a8f1-40e4-4dad-9351-b502c5d0117c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.262227] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.470025] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.470025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.470025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.470025] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.770660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.770660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.770660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.770660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.770660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.770660] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 is going to be created. [ 859.800326] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.800541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.800622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.800842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.802746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.815788] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: UNINITIALIZED for 2s [ 859.972897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.973482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.973628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.973907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.974180] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.974587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.974766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.975048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.975471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.975471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.975681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.975773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.975894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.976019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.976178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.976279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.976341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.976489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.976565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.976650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.976764] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.481421] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d51d74c1-0bc9-4f08-9e69-0f36720ce33b: rpc.has_security_group_logging(os_id): False [ 860.503807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.504026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.504089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.504310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.535027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.535027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.535027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.535027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.535027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.535027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.535027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.535944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.536363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.536363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.536363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.536590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.536682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.536759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.536943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.537020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.537104] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 860.634926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.635183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.635183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.635606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.635606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.655598] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 860.673902] env[65319]: INFO networking_nsxv3.common.synchronization [req-38e27cbf-8f0a-4704-874f-9f2eb1b3f343 req-487e4995-7766-4414-bd3c-ab26498012fe tempest-ServersAdminNegativeTestJSON-701324115 tempest-ServersAdminNegativeTestJSON-701324115-project-member] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 860.674549] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 860.674955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.675304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.675393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.675631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.675866] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.676041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.679051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.679051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.679051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.679051] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.931612] env[65319]: INFO networking_nsxv3.common.synchronization [req-8776776c-d922-442d-a5ee-71f212baf002 req-dc3ff29d-186b-4317-9fec-9fbcbdc1298c tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 860.934918] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 860.935405] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.935574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.935711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.935943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.936135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.936280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.936381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.936618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.936732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.936854] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.179585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.441530] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.682406] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.838241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: SUCCESS [ 861.838633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.838948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.839225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.839509] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.839643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.839706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.839997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.840129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.840289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.840417] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.943838] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.187394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.187394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.187394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.187575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.187575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.187642] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 862.242339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.242525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.242568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.243875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.243875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.265045] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 862.344435] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.449031] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.449031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.449031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.449031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.449031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.449031] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 862.485880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.485880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.485880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.485880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.485880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.497878] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 862.618452] env[65319]: INFO networking_nsxv3.common.synchronization [req-83aa3282-5f8c-4a8c-83e6-0e5c469ab6df req-9a16c6f6-f691-429b-bebe-89593d0de907 tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 862.619869] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 862.621287] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.621400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.621489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.621684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.621894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.622029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.622102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.622240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.622321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.622438] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.686651] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 862.686651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.847212] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a10b7b6b-66cd-4787-963f-d00ded9a0b66: rpc.has_security_group_logging(os_id): False [ 862.897336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.897566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.898600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.899103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.899103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.899674] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.900165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.900550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.901496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.901854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.901854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 is going to be created. [ 863.028983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.029243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.029304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.029600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.029812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.039249] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.039720] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.039720] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.040062] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.040415] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.040640] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.040801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.041106] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.041217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.041431] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.041549] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.041659] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.041771] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.041881] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.042106] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.042162] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.054217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: IN_PROGRESS for 2s [ 863.068117] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.068305] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.068449] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.068629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.068960] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.069160] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.069281] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.069638] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.069785] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.124950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.125224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.125314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.125504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.164809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.165124] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.165249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.165330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.165813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.165929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.165992] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 863.206392] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.206671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.206671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.206880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.206971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.218412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 863.572909] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.573264] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.573413] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.573724] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.573905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.574075] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 not found, creating... [ 863.574356] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.574519] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.574635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.574893] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.575045] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.575346] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.575533] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.575658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.575888] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.576069] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.576234] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 is going to be created. [ 863.599857] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.600088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.600208] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.600526] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.600837] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.601118] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.275626] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 864.276087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.401386] env[65319]: INFO networking_nsxv3.common.synchronization [req-83aa3282-5f8c-4a8c-83e6-0e5c469ab6df req-32810244-3f22-4b73-89f5-d50717542187 service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 864.401653] env[65319]: INFO networking_nsxv3.common.synchronization [req-83aa3282-5f8c-4a8c-83e6-0e5c469ab6df req-32810244-3f22-4b73-89f5-d50717542187 service nova] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 864.401822] env[65319]: INFO networking_nsxv3.common.synchronization [req-83aa3282-5f8c-4a8c-83e6-0e5c469ab6df req-32810244-3f22-4b73-89f5-d50717542187 service nova] Enqueued Resource ID: b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 with Priority: HIGHEST for action port [ 864.402309] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_rules [ 864.404436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 864.404436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 with Priority: HIGHEST for action port [ 864.404436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.404436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.404436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.404436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.404436] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.404436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.404951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.405919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.406210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.406210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.406527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.407069] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.510447] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 864.510690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.908897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.908897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.910547] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 with status ACTIVE [ 864.910735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.910886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.910998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.911362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.911516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.911745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.912047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.912047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.912329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.912454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.912758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.912883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.913029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.913158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.913251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.913350] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8 is going to be updated. [ 864.940423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.940423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.940423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.940423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.940423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.940423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00ea7ae-38bf-42bf-8ad0-f0649ed8e5b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.075748] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: SUCCESS [ 865.075990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.231157] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 865.231420] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 deletion is rescheduled due to dependency. [ 865.231851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.231985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.232342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.232597] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.232764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.232856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.233259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.233412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.233634] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.736938] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.239451] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.483995] env[65319]: INFO networking_nsxv3.common.synchronization [req-030f30d3-a984-4826-8893-48f2a7d8607f req-400a2a3e-64a3-4b85-9d7a-768574573f62 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 866.484582] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 866.484916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.485080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.485174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.485490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.485658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.485771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.485835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.485997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.486120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.486218] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.745340] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.745340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.745340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.745919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.745919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.745919] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 866.777224] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.777358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.777429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.777641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.777787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.787061] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 866.883224] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.883819] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.885254] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.885254] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.885254] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.885713] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.885981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.886462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.886771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.887995] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.887995] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.887995] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.887995] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.887995] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.887995] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.887995] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.915242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.915424] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.915561] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.915762] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.916103] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.916284] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.916404] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.916747] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.916990] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09eddf2a-83d7-4e0f-9a9a-407439ca99c8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.989874] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.989874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.989874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.990126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.990193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.990481] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.991247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.993669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.993669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.993669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.993669] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a6c793-0760-435d-be82-33d755948f79 already deleted. [ 866.993669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.421009] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.421334] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.421471] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.421778] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.421933] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.422108] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 not found, creating... [ 867.422517] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.422689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.422986] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.423284] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.423550] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.423892] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.424676] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.424676] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.424676] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.425048] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.425168] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 is going to be created. [ 867.448618] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.448848] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.448994] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.449341] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.449632] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.449997] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.188395] env[65319]: INFO networking_nsxv3.common.synchronization [req-030f30d3-a984-4826-8893-48f2a7d8607f req-926046e1-86be-47f6-b09f-8c0ef2c9ff30 service nova] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 868.188395] env[65319]: INFO networking_nsxv3.common.synchronization [req-030f30d3-a984-4826-8893-48f2a7d8607f req-926046e1-86be-47f6-b09f-8c0ef2c9ff30 service nova] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 868.189623] env[65319]: INFO networking_nsxv3.common.synchronization [req-030f30d3-a984-4826-8893-48f2a7d8607f req-926046e1-86be-47f6-b09f-8c0ef2c9ff30 service nova] Enqueued Resource ID: 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 with Priority: HIGHEST for action port [ 868.190347] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_rules [ 868.190496] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 868.190597] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 with Priority: HIGHEST for action port [ 868.190899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.191045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.191127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.191343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.191431] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.192429] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.192551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.192619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.192898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.193080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.193278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.193350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.193509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.193599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.193690] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.195119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.195119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.195119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.195119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.195119] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09eddf2a-83d7-4e0f-9a9a-407439ca99c8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.697585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.699035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.699035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.700039] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 with status ACTIVE [ 868.700177] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.700426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.700426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.700855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.700855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.700968] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.701064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.701201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.701339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.701440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.701655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.701790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.701880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.702066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.702147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.702238] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09eddf2a-83d7-4e0f-9a9a-407439ca99c8 is going to be updated. [ 868.728545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.728814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.728898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.729191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.729426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.729605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09eddf2a-83d7-4e0f-9a9a-407439ca99c8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.800828] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 868.801058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.801157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.801380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.805027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.805027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.805027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.805027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.805027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.805027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.805027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.206437] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.307681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.308083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.308083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.308188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.308339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.308470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.308509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.308924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.308924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.308924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.308924] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.309138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.309138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.309224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.309350] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.310634] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.708223] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.708416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.708497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.708674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.708754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.708848] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a6c793-0760-435d-be82-33d755948f79 is going to be created. [ 869.743889] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.744132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.744132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.744376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.744467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.754646] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: UNINITIALIZED for 2s [ 869.813185] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6058afe7-0c04-438a-8ff7-fa0b65021981: rpc.has_security_group_logging(os_id): False [ 869.836719] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.836719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.836719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.836719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.837194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.837194] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.837194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.837368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.837412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.837476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.837649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.837762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.837821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.837933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.838015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.838211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.838353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.838353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.838525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.838612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.838679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 869.911752] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.911997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.911997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.912308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.912500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.929859] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 871.765315] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: SUCCESS [ 871.765650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.765723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.765974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.766221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.766347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.766412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.766592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.766676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.766774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.766855] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.951085] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 871.951085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.269242] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.702844] env[65319]: INFO networking_nsxv3.common.synchronization [req-e1df0e1f-9443-4c34-b18e-9501d7f0f8da req-cf323742-d5f6-44d0-8850-d9102003962f tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 872.703510] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 872.705047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.705047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.705047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.705047] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.772859] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0a6c793-0760-435d-be82-33d755948f79: rpc.has_security_group_logging(os_id): False [ 872.791613] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.791695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.791695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.791950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.792084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.792434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.792531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.792595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.792803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.792918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.793029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6c793-0760-435d-be82-33d755948f79 is going to be created. [ 872.896243] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.896243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.896243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.896243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.896243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.910150] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: IN_PROGRESS for 2s [ 873.107145] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.107330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.107450] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.107727] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.108022] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.108179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.108291] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.108925] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.108925] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.108925] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.109715] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.109839] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.109960] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.110092] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.110199] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.110332] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.136336] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.136543] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.136697] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.136879] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.137598] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-cfd9675d-f5ce-4fb4-865c-4756cbd90502 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.137849] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.137993] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.138352] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.138494] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd9675d-f5ce-4fb4-865c-4756cbd90502',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.209477] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.212040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.212040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.212040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.238117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.238628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.238824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.239341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.239341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.239465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.240158] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 873.268611] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.268696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.268748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.269067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.269618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.282596] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 873.328652] env[65319]: INFO networking_nsxv3.common.synchronization [req-e8c3b27a-2322-4945-bed4-d597dfbf271e req-d4d1ca33-f4d0-4ee9-8119-710a6bb72dc5 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 873.329298] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 873.330371] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.330371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.330371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.330371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.330371] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.330686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.330686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.330686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.330795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.330873] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.642067] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.642696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.642696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.642881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.643031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.643186] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port cfd9675d-f5ce-4fb4-865c-4756cbd90502 not found, creating... [ 873.645056] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.645056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.645056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.645056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.645056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.645056] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.645056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.645532] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.645532] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.645630] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.646234] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: cfd9675d-f5ce-4fb4-865c-4756cbd90502 is going to be created. [ 873.670921] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.670921] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.670921] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.671335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.671684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.672087] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.833705] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.336588] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.409480] env[65319]: INFO networking_nsxv3.common.synchronization [req-e1df0e1f-9443-4c34-b18e-9501d7f0f8da req-fd518cb4-41b9-41af-bf29-4f3b4fcea4ad service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 874.409654] env[65319]: INFO networking_nsxv3.common.synchronization [req-e1df0e1f-9443-4c34-b18e-9501d7f0f8da req-fd518cb4-41b9-41af-bf29-4f3b4fcea4ad service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 874.410065] env[65319]: INFO networking_nsxv3.common.synchronization [req-e1df0e1f-9443-4c34-b18e-9501d7f0f8da req-fd518cb4-41b9-41af-bf29-4f3b4fcea4ad service nova] Enqueued Resource ID: cfd9675d-f5ce-4fb4-865c-4756cbd90502 with Priority: HIGHEST for action port [ 874.410289] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 874.410423] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 874.410518] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd9675d-f5ce-4fb4-865c-4756cbd90502 with Priority: HIGHEST for action port [ 874.411384] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.411520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.411587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.411787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.411880] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.412710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.414453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.414453] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd9675d-f5ce-4fb4-865c-4756cbd90502 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.414453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.414453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.414453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.414453] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd9675d-f5ce-4fb4-865c-4756cbd90502',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.839173] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.839482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.839482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.839648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.839738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.839850] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 874.875945] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.876725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.876832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.877011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.877173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.886675] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 874.916611] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.916758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.916952] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfd9675d-f5ce-4fb4-865c-4756cbd90502 with status ACTIVE [ 874.917148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.917283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.917333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.917532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.917638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.917791] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.917965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.918096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.918227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.920014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.920014] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.920014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.920014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.920014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.920014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.920014] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfd9675d-f5ce-4fb4-865c-4756cbd90502 is going to be updated. [ 874.930647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: SUCCESS [ 874.931584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.951940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.951940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.951940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.951940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.952297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.952297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd9675d-f5ce-4fb4-865c-4756cbd90502" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.294089] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 875.294341] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 875.294422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.294585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.294957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.295089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.295208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.295269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.295437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.295552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.295726] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.800303] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.302855] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.806414] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.806716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.806878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.807181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.807372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.807554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 876.853271] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.853475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.853521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.854096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.854096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.865138] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 876.899492] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 876.899492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.743089] env[65319]: INFO networking_nsxv3.common.synchronization [req-6bb23742-2580-4e36-a890-9871d19e8e2f req-7dd3ced1-0fa6-4794-a950-7db2c97c67a3 tempest-ImagesOneServerNegativeTestJSON-1065479101 tempest-ImagesOneServerNegativeTestJSON-1065479101-project-member] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 877.744877] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGHEST for action security_group_members [ 877.745601] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.745601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.745601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.745601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.745965] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.745965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.745965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.746128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.746214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.746310] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.249248] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.249248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.249521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.249617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.249815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.250090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.250251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.250948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.250948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.250948] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be updated. [ 878.282215] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.282215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.282215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.282491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.282572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.293665] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: IN_PROGRESS for 2s [ 878.878064] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.878064] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.878064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.878064] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.381783] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.381992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.382036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.382258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.382434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.382533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.382595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.382752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.382856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.382944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.383106] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.383662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.383662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.383662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.383662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.383662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.383662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.383870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.383870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.384417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.384417] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.681098] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7c0089f-97fa-4fda-ad13-57b13ac44ffa req-09ef2a1c-2d71-4fa7-83e3-554f4e24ca7c tempest-ServersV294TestFqdnHostnames-85723109 tempest-ServersV294TestFqdnHostnames-85723109-project-member] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 879.681511] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGHEST for action security_group_members [ 879.682893] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.682893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.683617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.684331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.684579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.684756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.684865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.685290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.685290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.685903] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.892096] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 879.913470] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.913651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.913728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.913964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.914446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.914446] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.914446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.914608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.914682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.914802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.915033] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.915144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.915228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.916085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.916085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.916770] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.916910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.916982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.917144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.917219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.917304] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 879.983625] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.983625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.983833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.983859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.984141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.998193] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 880.191196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.191196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.191196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.191196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.191196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.191361] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.191449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.191449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.191602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.191679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.191761] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 is going to be updated. [ 880.221905] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.221905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.221905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.221905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.221905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.232861] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: IN_PROGRESS for 2s [ 880.302360] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 in Status: SUCCESS [ 880.302545] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 deletion is rescheduled due to dependency. [ 880.302665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.896483] env[65319]: INFO networking_nsxv3.common.synchronization [req-b6d39ada-6a02-4b31-bc24-910404d94272 req-9fee7bd0-a2b0-4820-98c7-2851098565df tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 881.896897] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 881.897895] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.897895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.897895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.898058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.898229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.898418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.898418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.898618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.898729] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.027071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 882.030447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.245267] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78252624-98d5-4868-98b5-8ddc06e222b7 in Status: SUCCESS [ 882.245502] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 deletion is rescheduled due to dependency. [ 882.245629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.401972] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.744614] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-86769158-3a1c-4124-9254-2f934900f20b tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 882.745762] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 882.745762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.745762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.745762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.747134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.747134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.747134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.747134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.747134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.747671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.747671] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.904104] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.174755] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.177071] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.177071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.177071] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.177071] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.177071] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.177071] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.177699] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.177699] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.177699] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.197053] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.197289] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.197919] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.197919] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.198093] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.198181] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.198298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.198722] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.198794] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46c119b1-1b2b-4ace-bffd-96d9517e6e2f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.252897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.252897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.252897] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 already deleted. [ 883.252897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.407670] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.408534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.408534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.408534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.408534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.408534] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 883.449879] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.449879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.449879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.450023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.450227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.462015] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 883.701885] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.702119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.702251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.702606] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.702839] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.703042] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 46c119b1-1b2b-4ace-bffd-96d9517e6e2f not found, creating... [ 883.703388] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.703643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.703782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.704076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.704265] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.704644] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.704852] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.705015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.705298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.705472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.705655] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 46c119b1-1b2b-4ace-bffd-96d9517e6e2f is going to be created. [ 883.727493] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.727700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.727823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.728107] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.728337] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.728597] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.481199] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-63cc9bc0-849c-4c25-b564-99a643680073 service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 884.481199] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-63cc9bc0-849c-4c25-b564-99a643680073 service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 884.481199] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-63cc9bc0-849c-4c25-b564-99a643680073 service nova] Enqueued Resource ID: 46c119b1-1b2b-4ace-bffd-96d9517e6e2f with Priority: HIGHEST for action port [ 884.482333] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 884.482333] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 884.482427] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46c119b1-1b2b-4ace-bffd-96d9517e6e2f with Priority: HIGHEST for action port [ 884.483644] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.483644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.483644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.483971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.484098] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.485792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.486168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.486272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.486504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.486714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.486860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.486952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.487252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.487252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.487392] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.488914] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.488914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.489069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.489205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.489309] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46c119b1-1b2b-4ace-bffd-96d9517e6e2f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.942914] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a0aaa6f-2d5e-4cdf-9acf-1a1bc55844e3 req-1166eb9c-5847-418c-ab36-6a0d9bf6ba4b tempest-ListImageFiltersTestJSON-1347272766 tempest-ListImageFiltersTestJSON-1347272766-project-member] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 884.943482] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 884.943847] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.943971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.943971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.944185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.944343] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.944441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.944502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.944649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.944737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.944838] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.991709] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.994518] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46c119b1-1b2b-4ace-bffd-96d9517e6e2f with status ACTIVE [ 884.994518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.994518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.994518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.994518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.994518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.994831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.994962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.995037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.995218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.995307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.995515] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.995627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.995693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.995852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.995934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.996176] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46c119b1-1b2b-4ace-bffd-96d9517e6e2f is going to be updated. [ 884.997890] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.997890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.021590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.021743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.021813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.022039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.022176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.022330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46c119b1-1b2b-4ace-bffd-96d9517e6e2f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.447444] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.456943] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-835634f1-b8d1-455f-ab76-bb44a1f65682 tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 885.457980] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 885.459536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.459536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.472443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 885.472487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.499234] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.817424] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.817678] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.817852] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.819363] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.819994] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.820298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.823435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.823435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.823435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.823435] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.823435] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.823435] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.823435] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.823435] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.823435] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.823435] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.843224] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.843496] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.844059] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.844139] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.844451] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-f78300e0-a559-423f-9237-9d85512e0dad taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.844695] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.844881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.845285] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.845506] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f78300e0-a559-423f-9237-9d85512e0dad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.903244] env[65319]: INFO networking_nsxv3.common.synchronization [req-50345699-b2fe-402e-8ab3-08b76f9a5282 req-fcd45a36-536b-4dcd-bca0-89c55b1922d1 tempest-ServersWithSpecificFlavorTestJSON-667662474 tempest-ServersWithSpecificFlavorTestJSON-667662474-project-member] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 885.905148] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGHEST for action security_group_members [ 885.905148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.905148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.905148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.905148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.905333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.905333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.905405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.905528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.905604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.906189] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.950626] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.001991] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.002156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.002214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.002441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.002569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.002638] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be created. [ 886.027660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.027849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.027948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.028200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.028377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.040380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: UNINITIALIZED for 2s [ 886.348130] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.348245] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.348370] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.348670] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.348817] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.348964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port f78300e0-a559-423f-9237-9d85512e0dad not found, creating... [ 886.349405] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.349598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.349758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.350062] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.350227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.350522] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.350679] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.350798] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.351016] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.351158] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.351298] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: f78300e0-a559-423f-9237-9d85512e0dad is going to be created. [ 886.374555] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.374799] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.374967] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.375256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.375498] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.375720] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.407458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.407627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.407695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.407905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.428399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.428645] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.428781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.428850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.429059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.429144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.429233] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be updated. [ 886.453268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.453467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.453549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.453968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.453968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.454130] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 886.470276] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.470276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.470566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.470566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.470698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.479417] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: IN_PROGRESS for 2s [ 886.510805] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.510805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.510805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.510805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.510805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.520705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 887.102550] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-0e3d082e-cbb8-4fbd-833c-a80f9f19dde9 service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 887.102806] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-0e3d082e-cbb8-4fbd-833c-a80f9f19dde9 service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 887.102990] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-0e3d082e-cbb8-4fbd-833c-a80f9f19dde9 service nova] Enqueued Resource ID: f78300e0-a559-423f-9237-9d85512e0dad with Priority: HIGHEST for action port [ 887.103642] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 887.103893] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 887.103970] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78300e0-a559-423f-9237-9d85512e0dad with Priority: HIGHEST for action port [ 887.104381] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.104473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.104659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.104782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.105080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f78300e0-a559-423f-9237-9d85512e0dad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.105201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.105251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.105455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.105896] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f78300e0-a559-423f-9237-9d85512e0dad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.609352] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f78300e0-a559-423f-9237-9d85512e0dad with status ACTIVE [ 887.609668] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.609848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.609848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.610172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.610207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.610621] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.610621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.610621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.610819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.610819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.610988] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.611107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.611164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.611343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.611390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.611459] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f78300e0-a559-423f-9237-9d85512e0dad is going to be updated. [ 887.633298] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.633453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.633565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.633784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.633923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.634104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f78300e0-a559-423f-9237-9d85512e0dad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.053877] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 888.053877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.053877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.054070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.054150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.054276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.054316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.054503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.056465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.056993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.057409] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.060171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.060171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.060171] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.060286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.060286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.060407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.060498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.060592] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.115723] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-d1057f26-325d-435b-9f9c-f2c96daa0b33 tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 888.116351] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 888.116690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.117126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.490377] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 in Status: SUCCESS [ 888.490537] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 deletion is rescheduled due to dependency. [ 888.490653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.530493] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 888.530730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.563664] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.563985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.564129] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.892774] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.892774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.892774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.892774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.893514] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.894032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.894348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.894921] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.895214] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.895696] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.896083] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.896303] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.896517] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.896873] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.897203] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.897432] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.918954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.918954] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.919176] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.919721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-602" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.919721] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-fbc30833-dc97-44eb-91b6-81fc87581e60 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.920042] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.920164] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.920548] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.921637] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc30833-dc97-44eb-91b6-81fc87581e60',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.067331] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.424060] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.424060] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.424316] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.424561] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.424784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.425060] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port fbc30833-dc97-44eb-91b6-81fc87581e60 not found, creating... [ 889.425374] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.425536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.425658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.425920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.426112] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.426411] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.426566] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.426688] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.426902] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.427054] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.427207] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: fbc30833-dc97-44eb-91b6-81fc87581e60 is going to be created. [ 889.453926] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.454159] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.454284] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.454552] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.454779] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.455248] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.570057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.570057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.570057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.570340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.570386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.570929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 889.627352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.627352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.627352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.627352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.627352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.640309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-c560c96c-8f73-4cf9-a1c7-08d6d2d12fdd service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-c560c96c-8f73-4cf9-a1c7-08d6d2d12fdd service nova] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [req-1ead8d30-6637-41d8-a143-6915806741a1 req-c560c96c-8f73-4cf9-a1c7-08d6d2d12fdd service nova] Enqueued Resource ID: fbc30833-dc97-44eb-91b6-81fc87581e60 with Priority: HIGHEST for action port [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_rules [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 890.190097] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc30833-dc97-44eb-91b6-81fc87581e60 with Priority: HIGHEST for action port [ 890.190931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.191053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.191286] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.191386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.191575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbc30833-dc97-44eb-91b6-81fc87581e60 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.191647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.191691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.191921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.192017] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc30833-dc97-44eb-91b6-81fc87581e60',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.695091] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbc30833-dc97-44eb-91b6-81fc87581e60 with status ACTIVE [ 890.695655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.695655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.695655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.695923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.696109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.696282] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.696408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.696474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.696643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.696734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.696987] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.697091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.697134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.697290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.697367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.697489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbc30833-dc97-44eb-91b6-81fc87581e60 is going to be updated. [ 890.720549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.720732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.720834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.721090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.721255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.721452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbc30833-dc97-44eb-91b6-81fc87581e60" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.651557] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 891.651913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.651953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.652984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.653213] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.653341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.653412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.653607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.653705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.653817] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.156031] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.658170] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.163217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.163568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.163648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.164109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.164226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.164577] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 893.197638] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.197833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.197879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.198121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.198280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.211159] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 895.057744] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c53194f7-8f50-459f-bb8f-c7ba2198433a None None] Enqueued Resource ID: 40f7b566-21ce-4503-ac26-8990f39a8cf2 with Priority: HIGHEST for action port [ 895.058653] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f7b566-21ce-4503-ac26-8990f39a8cf2 with Priority: HIGHEST for action port [ 895.058723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f7b566-21ce-4503-ac26-8990f39a8cf2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.062053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f7b566-21ce-4503-ac26-8990f39a8cf2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.062053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f7b566-21ce-4503-ac26-8990f39a8cf2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.062053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f7b566-21ce-4503-ac26-8990f39a8cf2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.062053] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f7b566-21ce-4503-ac26-8990f39a8cf2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.226688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 895.228777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.228777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.228777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.228777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.228777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.228777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.231185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.231185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.231185] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.565665] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40f7b566-21ce-4503-ac26-8990f39a8cf2 [ 895.565833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.566034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.566122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.566394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.566521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.566632] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40f7b566-21ce-4503-ac26-8990f39a8cf2 already deleted. [ 895.566741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f7b566-21ce-4503-ac26-8990f39a8cf2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.734132] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.117180] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d26c2cd-24d8-4119-b40b-5383e7035e0e req-e590b95b-21cf-4b20-a5ec-ec6fb914b6fb tempest-ServersTestJSON-514632879 tempest-ServersTestJSON-514632879-project-member] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 896.117843] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGHEST for action security_group_members [ 896.118057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.118283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.118283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.118486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.118630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.118729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.118778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.118921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.119016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.119391] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.236400] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.622027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.622236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.622453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.622511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.622563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.622753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.622842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.622905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.623065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.623145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.623265] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad is going to be updated. [ 896.651824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.653832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.653832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.653832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.653832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.665688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: IN_PROGRESS for 2s [ 896.739921] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.740096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.740170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.740701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.740701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.740701] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 896.772191] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.772350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.772350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.772625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.772843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.783800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 897.676471] env[65319]: INFO networking_nsxv3.common.synchronization [None req-6e927660-478a-4daa-b3ed-e8cab8cf5573 None None] Enqueued Resource ID: bdd1e2dc-8d89-468c-91e4-be75fe3712f1 with Priority: HIGHEST for action port [ 897.677074] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd1e2dc-8d89-468c-91e4-be75fe3712f1 with Priority: HIGHEST for action port [ 897.678111] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdd1e2dc-8d89-468c-91e4-be75fe3712f1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.678332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdd1e2dc-8d89-468c-91e4-be75fe3712f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.678407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdd1e2dc-8d89-468c-91e4-be75fe3712f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.679027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdd1e2dc-8d89-468c-91e4-be75fe3712f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.679027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd1e2dc-8d89-468c-91e4-be75fe3712f1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.183834] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdd1e2dc-8d89-468c-91e4-be75fe3712f1 [ 898.185237] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.185237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.185237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.185237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.185237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.185237] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdd1e2dc-8d89-468c-91e4-be75fe3712f1 already deleted. [ 898.185237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdd1e2dc-8d89-468c-91e4-be75fe3712f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.597979] env[65319]: INFO networking_nsxv3.common.synchronization [None req-50776cb0-770f-4ded-b7d8-9ff3a40e19ca None None] Enqueued Resource ID: 2c800198-295e-4336-a64b-38b72150594a with Priority: HIGHEST for action port [ 898.598562] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c800198-295e-4336-a64b-38b72150594a with Priority: HIGHEST for action port [ 898.601932] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c800198-295e-4336-a64b-38b72150594a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.602018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c800198-295e-4336-a64b-38b72150594a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.602048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c800198-295e-4336-a64b-38b72150594a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.602429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c800198-295e-4336-a64b-38b72150594a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.602429] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c800198-295e-4336-a64b-38b72150594a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.607977] env[65319]: INFO networking_nsxv3.common.synchronization [req-2620cabb-fd6b-4ba2-877c-f735b36e82bc req-cb29b47a-fed7-4a3e-81f9-0fc389c94d7a tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 898.608728] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 898.609076] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.609631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.609749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.610018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.610193] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.610323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.610402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.611206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.611206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.611206] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.676483] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad in Status: SUCCESS [ 898.676788] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad deletion is rescheduled due to dependency. [ 898.676788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.794080] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 898.795219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.795413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.795679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.797792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.797792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.797792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.797792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.797792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.797792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.798174] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.798174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.798174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.798442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.798594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.798714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.798779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.798923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.798998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.799424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.799424] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.800124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.800326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.800435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.800553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.800616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.800725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.800795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.800919] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.983546] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.983546] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.983717] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.983998] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.984293] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.984461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.984581] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.984796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.984980] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.985332] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.985506] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.985684] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.985846] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.986031] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.986156] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.986305] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.006531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.006744] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.006857] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.007162] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.007421] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-03412d6c-40ec-4212-b089-2168607a8bd7 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.007638] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.010103] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011509] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.011724] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03412d6c-40ec-4212-b089-2168607a8bd7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.107128] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c800198-295e-4336-a64b-38b72150594a [ 899.107499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.107948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.107948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.108223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.108324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.108422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c800198-295e-4336-a64b-38b72150594a already deleted. [ 899.108505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c800198-295e-4336-a64b-38b72150594a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.113080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.115214] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.115214] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f already deleted. [ 899.115214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.302491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4334772-46a4-4ed8-9e08-70d20fdec313: rpc.has_security_group_logging(os_id): False [ 899.303926] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.348628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.348628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.348628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.348628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.348628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.348628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.348628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.348897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.349309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.349458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.349868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.349998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.350234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.351079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.352624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.352624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.352624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.352624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.352624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.352997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.353788] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be created. [ 899.436244] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.436244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.436244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.436376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.436693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.447711] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 899.514249] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.514590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.514757] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.515107] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.515282] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.515456] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 03412d6c-40ec-4212-b089-2168607a8bd7 not found, creating... [ 899.515748] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.515952] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.516128] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.516583] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.516783] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.517206] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.517422] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.517583] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.517887] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.518088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.518307] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 03412d6c-40ec-4212-b089-2168607a8bd7 is going to be created. [ 899.553258] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.553572] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.553691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.554212] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.554632] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.554962] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.808036] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.315411] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.315592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.315655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.316765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.316765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.316765] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 900.348296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.348462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.348591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.348746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.349031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.362114] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 900.414176] env[65319]: INFO networking_nsxv3.common.synchronization [req-2620cabb-fd6b-4ba2-877c-f735b36e82bc req-2d0ca906-c2e9-41f3-95c2-dff8d615a793 service nova] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 900.414176] env[65319]: INFO networking_nsxv3.common.synchronization [req-2620cabb-fd6b-4ba2-877c-f735b36e82bc req-2d0ca906-c2e9-41f3-95c2-dff8d615a793 service nova] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 900.414176] env[65319]: INFO networking_nsxv3.common.synchronization [req-2620cabb-fd6b-4ba2-877c-f735b36e82bc req-2d0ca906-c2e9-41f3-95c2-dff8d615a793 service nova] Enqueued Resource ID: 03412d6c-40ec-4212-b089-2168607a8bd7 with Priority: HIGHEST for action port [ 900.414176] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_rules [ 900.415185] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 900.415759] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03412d6c-40ec-4212-b089-2168607a8bd7 with Priority: HIGHEST for action port [ 900.416568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.417060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.419058] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.419058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.419058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.419058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.420232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.420232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.420232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.420232] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.423403] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-03412d6c-40ec-4212-b089-2168607a8bd7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.423555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.423643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.423835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.423915] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03412d6c-40ec-4212-b089-2168607a8bd7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.925866] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.926235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.926235] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.927109] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03412d6c-40ec-4212-b089-2168607a8bd7 with status ACTIVE [ 900.927364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.927491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.927543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.927739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.927826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.928097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.928209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.928244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.928981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.928981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.928981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.928981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.928981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.929295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.929295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.929295] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03412d6c-40ec-4212-b089-2168607a8bd7 is going to be updated. [ 900.951663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.951836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.951877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.952114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.952250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.952416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03412d6c-40ec-4212-b089-2168607a8bd7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.377753] env[65319]: INFO networking_nsxv3.common.synchronization [req-abfc1cf0-b160-4eb3-9564-c96b6fb4bab6 req-26882b3a-4587-49d3-b5ea-b068f375d393 tempest-ServerRescueTestJSON-74048994 tempest-ServerRescueTestJSON-74048994-project-member] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 901.378344] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 901.378715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.378880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.379462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.379632] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.379752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.379814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.379987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.380106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.382022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.432187] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.465088] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 901.465911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.467612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.467612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.467612] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.635366] env[65319]: INFO networking_nsxv3.common.synchronization [None req-a700b81f-c584-4d33-be8f-4c2c6a061b68 None None] Enqueued Resource ID: 70217223-0b26-46b4-abe0-4f53bb9ddd04 with Priority: HIGHEST for action port [ 901.635366] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70217223-0b26-46b4-abe0-4f53bb9ddd04 with Priority: HIGHEST for action port [ 901.639151] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-70217223-0b26-46b4-abe0-4f53bb9ddd04 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.639446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70217223-0b26-46b4-abe0-4f53bb9ddd04" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.639478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70217223-0b26-46b4-abe0-4f53bb9ddd04" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.639802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70217223-0b26-46b4-abe0-4f53bb9ddd04" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.643030] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70217223-0b26-46b4-abe0-4f53bb9ddd04',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.764071] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.764264] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.764398] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.764969] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.765204] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.765495] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.765495] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.765848] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.765918] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.766178] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.766293] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.766408] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.766509] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.766618] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.766721] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.766964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.793351] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.793535] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.793679] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.794251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-983" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.794332] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-a1b2ed3b-c942-452f-b859-21415b8f33e5 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.794532] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.794783] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.795150] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.795293] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b2ed3b-c942-452f-b859-21415b8f33e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.882682] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.934565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.934995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.934995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.935305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.935305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.935305] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f is going to be created. [ 901.963665] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.963835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.963878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.964220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.964301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.969170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.969303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.975014] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: UNINITIALIZED for 2s [ 902.143513] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70217223-0b26-46b4-abe0-4f53bb9ddd04 [ 902.143760] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.143897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.143970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.144217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.144311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.144405] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70217223-0b26-46b4-abe0-4f53bb9ddd04 already deleted. [ 902.144490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70217223-0b26-46b4-abe0-4f53bb9ddd04" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.299022] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.299301] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.299511] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.299797] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.299953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.300121] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port a1b2ed3b-c942-452f-b859-21415b8f33e5 not found, creating... [ 902.300383] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.300584] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.300672] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.300886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.301034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.301322] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.301476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.301593] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.301793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.301928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.302080] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: a1b2ed3b-c942-452f-b859-21415b8f33e5 is going to be created. [ 902.327012] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.327262] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.327403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.327674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.327896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.328210] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.373396] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 902.373669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.373833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.374069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.374272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.374394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.374461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.374655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.374764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.374793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.374864] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.386238] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.831730] env[65319]: INFO networking_nsxv3.common.synchronization [req-05edfc57-8eb2-4f51-a1f4-b1808ae84f36 req-566e2c23-6783-4db4-b203-f0a29f5b2aad tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 902.832908] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 902.833592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.834199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.834355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.834678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.834955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.835117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.835317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.835491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.835631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.835811] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.878531] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.878767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.890994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.891214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.891277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.891600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.891600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.892180] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be updated. [ 902.941084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.941084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.941387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.941387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.941913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.952493] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [req-abfc1cf0-b160-4eb3-9564-c96b6fb4bab6 req-09066980-540c-4e4c-b800-2d4a1deb43f2 service nova] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_rules [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [req-abfc1cf0-b160-4eb3-9564-c96b6fb4bab6 req-09066980-540c-4e4c-b800-2d4a1deb43f2 service nova] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [req-abfc1cf0-b160-4eb3-9564-c96b6fb4bab6 req-09066980-540c-4e4c-b800-2d4a1deb43f2 service nova] Enqueued Resource ID: a1b2ed3b-c942-452f-b859-21415b8f33e5 with Priority: HIGHEST for action port [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_rules [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 903.140055] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b2ed3b-c942-452f-b859-21415b8f33e5 with Priority: HIGHEST for action port [ 903.140055] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.140055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.140055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.141251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.141485] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.143126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.143484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.143897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1b2ed3b-c942-452f-b859-21415b8f33e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.144341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.144534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.144841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.145070] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b2ed3b-c942-452f-b859-21415b8f33e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.339796] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.648634] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.648771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.649013] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1b2ed3b-c942-452f-b859-21415b8f33e5 with status ACTIVE [ 903.649179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.649542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.649542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.649542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.649691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.649798] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.649863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.649930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.650876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.650876] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1b2ed3b-c942-452f-b859-21415b8f33e5 is going to be updated. [ 903.678452] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.678629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.678731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.678988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.679175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.679349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1b2ed3b-c942-452f-b859-21415b8f33e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.842129] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.984562] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: SUCCESS [ 903.984562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.984959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.985232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.985460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.985584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.985650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.985833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.986296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.986296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.986296] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.345089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.345259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.346526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.346526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.346526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.346526] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 904.375165] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.375435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.375435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.375693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.375862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.387381] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 904.489027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.964079] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 904.964267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.964510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.964878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.965194] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.965325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.965395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.965625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.965756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.965904] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.992147] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ff30f1-e83b-4620-bed8-4a797757bf9f: rpc.has_security_group_logging(os_id): False [ 905.024407] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.024636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.024783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.025362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.025541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.025917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.026102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.026221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.026921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.027425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.027425] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f is going to be created. [ 905.099842] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.100066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.100124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.100319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.100502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.112113] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: IN_PROGRESS for 2s [ 905.469162] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.975262] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.335961] env[65319]: INFO networking_nsxv3.common.synchronization [req-3cd34de6-fa93-4e0f-86c5-32ed8e78b7a1 req-43bcb0fa-7675-4701-9c74-82f9c1d1fd68 tempest-ServersAdminNegativeTestJSON-701324115 tempest-ServersAdminNegativeTestJSON-701324115-project-member] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 906.335961] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGHEST for action security_group_members [ 906.335961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.335961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.336560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.336560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.336645] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.336699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.336759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.336932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.337012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.337179] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.397480] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 906.397691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.397853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.398123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.398313] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.398426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.398500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.398662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.398738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.398820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.398979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.400022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.400022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.400523] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.479756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.479756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.479756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.479756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.479956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.479956] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be updated. [ 906.510134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.510291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.510371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.510593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.510739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.521182] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 906.846640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.846640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.846640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.846640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.846640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.847712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.847943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.848057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.848301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.848423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.848548] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be updated. [ 906.887415] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.887598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.887598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.887804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.887953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.899392] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: IN_PROGRESS for 2s [ 906.901860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4334772-46a4-4ed8-9e08-70d20fdec313: rpc.has_security_group_logging(os_id): False [ 906.922161] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.922525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.922617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.922898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.923017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.923272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.923427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.923493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.923693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.923865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.924327] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.924521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.924609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.924799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.924908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.925402] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.925577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.925676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.925884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.925995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.926128] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 907.262218] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: SUCCESS [ 907.262473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.266653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.266822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.266874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.267087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.267241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.293805] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 908.048119] env[65319]: INFO networking_nsxv3.common.synchronization [req-ee694841-772d-400a-b89d-599012c50a25 req-24d8b6b2-1f2a-48db-a0a6-e845bda70fc2 tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 908.048518] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 908.048819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.048955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.048999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.053228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.055120] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.055120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.055120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.055120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.055120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.055120] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.533131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 908.533364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.534296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.534296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.534296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.534296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.534296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.534296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.534561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.534561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.534561] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.557684] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.910506] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff in Status: SUCCESS [ 908.910724] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff deletion is rescheduled due to dependency. [ 908.910851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.038297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.038607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.038607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.038735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.038854] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.039021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.039127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.039361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.039361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.039483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.039694] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.039780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.039972] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.040065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.040171] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.040458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.040563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.040749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.040874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.040987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.041166] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.062023] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.309607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 909.310642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.311117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.312366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.312366] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.544210] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49a2be0-948f-4d73-a2fe-ec8e39d28abc: rpc.has_security_group_logging(os_id): False [ 909.564514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.564606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.564675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.564849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.565026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.565100] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 909.568810] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.568949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.569033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.569246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.569342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.569556] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.569701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.569772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.570177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.570177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.570272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.570346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.570392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.570511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.570589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.570771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.570864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.570991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.574083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.574201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.574306] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be updated. [ 909.602178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.602334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.602405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.602629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.602764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.615763] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 909.639323] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.639480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.639551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.639763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.639913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.667906] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 909.815503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.815503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.815503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.815690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.815922] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.816106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.816221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.816483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.816622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.816774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.816922] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.325492] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.325492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.325492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.325845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.325845] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.326123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.326351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.326535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.326764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.326886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.327091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.327208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.327289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.327522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.327703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.327825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.327933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.328131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.328190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.328278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.328369] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.832336] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4334772-46a4-4ed8-9e08-70d20fdec313: rpc.has_security_group_logging(os_id): False [ 910.851114] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.851283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.851368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.851600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.851694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.851925] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.852061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.852130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.852310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.852437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.852660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.852762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.852852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.853097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.853191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.853395] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.853493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.853572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.853730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.853821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.853908] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 910.919284] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.919501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.919501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.919733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.919882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.933065] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 911.626226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 911.626501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.684109] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 911.684351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.952884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 912.953187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.050034] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 913.050216] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 915.755435] env[65319]: INFO networking_nsxv3.common.synchronization [req-bc31ae7a-a73d-4456-b4e2-4258993dc1f0 req-e5548dc8-97a3-4bae-90a3-dc524005fbf3 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 915.756146] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 915.756518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.756675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.756747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.756997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.757200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.757361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.757447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.757562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.757670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.757831] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.260648] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.260996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.260996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.261222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.261275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.261620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.261620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.261620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.261813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.261813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.261965] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 916.296999] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.297251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.298020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.298020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.298020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.309672] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 918.322182] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 918.322460] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 918.322584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.757682] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 920.757682] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 920.980039] env[65319]: INFO networking_nsxv3.common.synchronization [req-1d9ec9cd-3bf5-425b-86fc-1c473e6eaaa0 req-aa86cc89-e0b0-4e98-bdfa-90b693955f5f tempest-ListImageFiltersTestJSON-1347272766 tempest-ListImageFiltersTestJSON-1347272766-project-member] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 920.980567] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGHEST for action security_group_members [ 920.980876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.981086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.981086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.981335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.981537] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.981728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.981797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.982020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.982113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.982221] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.484874] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.484874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.484874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.485071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.485102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.485336] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.485439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.485493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.485661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.485761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.485818] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be updated. [ 921.517152] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.517384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.517384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.517579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.517713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.519771] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.519994] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.520217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.521010] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.521477] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.521775] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.521942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.522232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.522456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.522767] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.523140] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.523416] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.523704] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.523866] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.524087] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.524271] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.534208] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: IN_PROGRESS for 2s [ 921.546622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.546801] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.546936] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.547131] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.547457] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-70960b46-9752-4fce-8cbe-778a9f785c2c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.547628] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.547744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.547994] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.548187] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70960b46-9752-4fce-8cbe-778a9f785c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.050366] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.050653] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.050926] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.051132] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.051323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.051843] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.052109] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.052227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.052514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.053025] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.053083] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.053311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.053673] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.053754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.054605] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.054605] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 70960b46-9752-4fce-8cbe-778a9f785c2c is going to be updated. [ 922.075642] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.076240] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.076240] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.076382] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.076468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.076684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.779998] env[65319]: INFO networking_nsxv3.common.synchronization [req-418398d2-a59c-4bfd-a7b0-76794923384b req-1fb17205-3aba-4112-aebd-c106a3d1f701 service nova] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 922.780197] env[65319]: INFO networking_nsxv3.common.synchronization [req-418398d2-a59c-4bfd-a7b0-76794923384b req-1fb17205-3aba-4112-aebd-c106a3d1f701 service nova] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 922.780447] env[65319]: INFO networking_nsxv3.common.synchronization [req-418398d2-a59c-4bfd-a7b0-76794923384b req-1fb17205-3aba-4112-aebd-c106a3d1f701 service nova] Enqueued Resource ID: 70960b46-9752-4fce-8cbe-778a9f785c2c with Priority: HIGHEST for action port [ 922.780966] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_rules [ 922.780966] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 922.780966] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70960b46-9752-4fce-8cbe-778a9f785c2c with Priority: HIGHEST for action port [ 922.781454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.781585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.781644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.781850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.781934] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.782926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.783085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.783214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.783381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.786088] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.786232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.786303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.786474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.786564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.786660] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.787613] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-70960b46-9752-4fce-8cbe-778a9f785c2c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.788628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.788628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.788628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.788628] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70960b46-9752-4fce-8cbe-778a9f785c2c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.039645] env[65319]: INFO networking_nsxv3.common.synchronization [req-edcb05a0-8208-4ad4-a159-50869d06ad92 req-34ec6445-4365-4c51-be12-aeb7b9d814db tempest-MigrationsAdminTest-845490578 tempest-MigrationsAdminTest-845490578-project-member] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 923.040302] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGHEST for action security_group_members [ 923.040666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.040786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.040852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.044025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.044789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.045798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.045798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.046078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.046078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.046078] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.290133] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.290133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.293251] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.293251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70960b46-9752-4fce-8cbe-778a9f785c2c with status ACTIVE [ 923.295119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.295119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.295119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.295119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.295119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.295119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.295596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.295799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.296115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.296346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.297368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.297368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.297368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.297368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.297368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.297368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70960b46-9752-4fce-8cbe-778a9f785c2c is going to be updated. [ 923.324188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.324419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.324419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.324682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.324854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.325066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70960b46-9752-4fce-8cbe-778a9f785c2c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.545315] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b6477e-560e-44cf-bf38-d612f918ff7e in Status: SUCCESS [ 923.545315] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e deletion is rescheduled due to dependency. [ 923.545570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.550135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.550280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.550280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.550444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.550539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.550735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.550837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.550900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.551056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.551132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.551211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be updated. [ 923.579342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.579516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.579579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.580571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.580571] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.613026] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8b53bcfd-3b05-4e83-aedb-9d8f9f633cba None None] Enqueued Resource ID: 99ab5a44-e170-40f7-8ae1-ebe665f7f680 with Priority: HIGHEST for action port [ 923.613026] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ab5a44-e170-40f7-8ae1-ebe665f7f680 with Priority: HIGHEST for action port [ 923.613860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ab5a44-e170-40f7-8ae1-ebe665f7f680 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.613860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ab5a44-e170-40f7-8ae1-ebe665f7f680" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.613860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ab5a44-e170-40f7-8ae1-ebe665f7f680" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.614217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ab5a44-e170-40f7-8ae1-ebe665f7f680" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.615519] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ab5a44-e170-40f7-8ae1-ebe665f7f680',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.630261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: IN_PROGRESS for 2s [ 923.799565] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.120481] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99ab5a44-e170-40f7-8ae1-ebe665f7f680 [ 924.120806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.120883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.120923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.121224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.121339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.121413] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99ab5a44-e170-40f7-8ae1-ebe665f7f680 already deleted. [ 924.121492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ab5a44-e170-40f7-8ae1-ebe665f7f680" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.305454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.305454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.305454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.305454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.305454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.305454] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be updated. [ 924.333135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.334106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.334106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.334106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.334106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.346692] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: IN_PROGRESS for 2s [ 924.553204] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7a38350-559d-4b28-a8a0-2c3ee84a0d8f req-d8795dc7-a708-43e4-b273-71b26c640223 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 924.553967] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 924.554488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.554689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.554900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.555338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.555602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.555769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.555878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.556076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.556184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.556268] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.996892] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.997222] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.997288] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.997735] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.998024] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.998306] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.998306] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.998588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.998700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.998953] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.999057] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.999167] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.999331] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.999419] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.999496] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.999677] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.020799] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.021025] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.021115] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.021299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.021613] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-79fedbfd-0eeb-4e3d-9243-17768c37be03 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.021792] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.021915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.022275] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.022420] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fedbfd-0eeb-4e3d-9243-17768c37be03',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.058409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.058803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.058803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.059411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.059411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.059491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.059600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.059931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.059931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.059931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.060144] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 already deleted. [ 925.060144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.525780] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.525780] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.526486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.526486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.526486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.526633] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 79fedbfd-0eeb-4e3d-9243-17768c37be03 not found, creating... [ 925.527052] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.527219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.527299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.527995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.527995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.527995] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.528237] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.528237] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.528449] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.528581] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.528720] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 is going to be created. [ 925.550065] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.550823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.550882] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.551166] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.551615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.551690] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.639443] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5208bd20-ecc1-41b5-aefd-e6b30792f4b5 None None] Enqueued Resource ID: fa0c6865-ab7f-443f-b108-a893896c0c19 with Priority: HIGHEST for action port [ 925.640423] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa0c6865-ab7f-443f-b108-a893896c0c19 with Priority: HIGHEST for action port [ 925.641323] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d in Status: SUCCESS [ 925.641492] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d deletion is rescheduled due to dependency. [ 925.641628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.641923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa0c6865-ab7f-443f-b108-a893896c0c19 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.642060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa0c6865-ab7f-443f-b108-a893896c0c19" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.642134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa0c6865-ab7f-443f-b108-a893896c0c19" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.642395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa0c6865-ab7f-443f-b108-a893896c0c19" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.642482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa0c6865-ab7f-443f-b108-a893896c0c19',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.144771] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa0c6865-ab7f-443f-b108-a893896c0c19 [ 926.145013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.145326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.145326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.145868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.146844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.146844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa0c6865-ab7f-443f-b108-a893896c0c19 already deleted. [ 926.146844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa0c6865-ab7f-443f-b108-a893896c0c19" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.356702] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 926.357037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.358121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.358121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.358121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.358121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.358121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.358121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.358396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.358596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.358738] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7a38350-559d-4b28-a8a0-2c3ee84a0d8f req-3be88643-ddaa-4d0f-8c83-321ed7d79430 service nova] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7a38350-559d-4b28-a8a0-2c3ee84a0d8f req-3be88643-ddaa-4d0f-8c83-321ed7d79430 service nova] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7a38350-559d-4b28-a8a0-2c3ee84a0d8f req-3be88643-ddaa-4d0f-8c83-321ed7d79430 service nova] Enqueued Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 926.388290] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 926.389689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.390173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.391300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.394476] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.394476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.394476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.394476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.394476] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.396480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fedbfd-0eeb-4e3d-9243-17768c37be03 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.396480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.396480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.396480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.397028] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fedbfd-0eeb-4e3d-9243-17768c37be03',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.492380] env[65319]: INFO networking_nsxv3.common.synchronization [None req-574a9b4c-9b40-4182-8d67-8e2f6b747107 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 926.495209] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 926.497250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.497473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.497574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.497903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.498064] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.861401] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.898080] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.899023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.899128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.900420] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79fedbfd-0eeb-4e3d-9243-17768c37be03 with status ACTIVE [ 926.900600] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.900718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.900784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.901369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.901369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.901369] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.901369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.901567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.901604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.901828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.901828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.901941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.901970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.902127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.902190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.902271] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 is going to be updated. [ 926.924289] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.924374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.924374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.924568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.924703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.924865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.024840] env[65319]: INFO networking_nsxv3.common.synchronization [None req-106745cc-8c72-43e1-a818-d9151bfab74d tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 927.025450] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 927.025760] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.025939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.028137] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.028137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.028137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.028137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.028137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.028137] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 already deleted. [ 927.028137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.029374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.029374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.029374] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.363843] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d9e57b-7b71-46dd-8bbf-e08a483c33e6: rpc.has_security_group_logging(os_id): False [ 927.383595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.386153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.386153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.386153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.386428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.386566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.386609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.386814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.387522] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be updated. [ 927.404399] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.459235] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.459235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.459235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.459235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.459235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.476347] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: IN_PROGRESS for 2s [ 927.557191] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.557334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.557531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.557607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.557692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.557781] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 already deleted. [ 927.557862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.907448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.907448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.907448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.907448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.907448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.908277] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be created. [ 927.936680] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.936852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.936893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.937130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.937357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.950610] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: UNINITIALIZED for 2s [ 928.098248] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e4929656-13eb-48bd-8c0a-465e145bfd62 None None] Enqueued Resource ID: 0055095e-3880-4a34-8b45-2447795228c4 with Priority: HIGHEST for action port [ 928.101686] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0055095e-3880-4a34-8b45-2447795228c4 with Priority: HIGHEST for action port [ 928.102075] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-0055095e-3880-4a34-8b45-2447795228c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.102201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0055095e-3880-4a34-8b45-2447795228c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.102275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0055095e-3880-4a34-8b45-2447795228c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.102544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0055095e-3880-4a34-8b45-2447795228c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.102694] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0055095e-3880-4a34-8b45-2447795228c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.605438] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0055095e-3880-4a34-8b45-2447795228c4 [ 928.605761] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.605987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.606142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.606489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.606684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.606872] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0055095e-3880-4a34-8b45-2447795228c4 already deleted. [ 928.607039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0055095e-3880-4a34-8b45-2447795228c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.494212] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 929.494604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.789533] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d865462-7646-46f0-875b-9086f535dffe req-6078d60a-cd07-4db6-833f-bbebf2fb6b42 tempest-ServersNegativeTestJSON-1277425665 tempest-ServersNegativeTestJSON-1277425665-project-member] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 929.790120] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 929.790523] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.791616] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.791616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.791616] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.962254] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 929.962494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.962670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.963288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.964105] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.964351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.964469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.964692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.964814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.964937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.965105] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.294435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.295306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.295306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.295306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.295306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.295522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.295684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.295832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.295984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.296137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.296226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef already deleted. [ 930.296446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.401110] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.401343] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.401472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.401793] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.402151] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.403086] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.403146] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.403423] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.404253] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.404492] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.404611] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.404722] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.404957] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.404957] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.405061] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.405249] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.426892] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.427082] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.427224] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.427430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.427714] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.427886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.428015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.428379] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.428562] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.467893] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.468048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.468172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.468333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.468511] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.468593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.468641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.468769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.468860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.468933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.469098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.469238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.469313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.469543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.469593] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.469685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.469761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.469867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.469936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.470024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.470117] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.627860] env[65319]: INFO networking_nsxv3.common.synchronization [None req-99359fc4-cacb-46b4-a7cc-50d413aca93e None None] Enqueued Resource ID: 7abd8bda-4547-45cc-b66c-e6d7151a885b with Priority: HIGHEST for action port [ 930.628600] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abd8bda-4547-45cc-b66c-e6d7151a885b with Priority: HIGHEST for action port [ 930.628920] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7abd8bda-4547-45cc-b66c-e6d7151a885b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.629063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7abd8bda-4547-45cc-b66c-e6d7151a885b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.629132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7abd8bda-4547-45cc-b66c-e6d7151a885b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.629415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7abd8bda-4547-45cc-b66c-e6d7151a885b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.629498] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7abd8bda-4547-45cc-b66c-e6d7151a885b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.934647] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.934896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.935073] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.935801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.935801] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.935801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e not found, creating... [ 930.935962] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.936120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.936239] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.936462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.936600] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.936889] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.937057] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.937176] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.937390] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.937544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.937684] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e is going to be created. [ 930.953845] env[65319]: INFO networking_nsxv3.common.synchronization [req-293482f7-4a04-4047-a2f3-424ba3b765cd req-bee835d1-90e1-4d52-ad68-6acd17ae74cd tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 930.954453] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 930.957065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.957065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.957065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.957065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.957364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.957364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.957487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.957659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.957754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.957890] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.968717] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.972088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.972088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.972088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.972088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.972088] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.974229] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9: rpc.has_security_group_logging(os_id): False [ 931.000082] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.000082] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.000082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.000525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.000661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.000958] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.001199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.001319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.001562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.001696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.002126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.002126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.002126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.002399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.002532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.002704] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be created. [ 931.098492] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.098492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.098492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.098492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.098492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.134025] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 931.134025] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7abd8bda-4547-45cc-b66c-e6d7151a885b [ 931.134025] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.134025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.134025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.134025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.134025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.134025] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7abd8bda-4547-45cc-b66c-e6d7151a885b already deleted. [ 931.134025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7abd8bda-4547-45cc-b66c-e6d7151a885b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.467044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.467044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.467044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.467044] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 931.504962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.504962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.504962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.504962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.504962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.514744] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 931.724190] env[65319]: INFO networking_nsxv3.common.synchronization [None req-8243831d-c985-45a8-9d73-1a5ea299adf2 None None] Enqueued Resource ID: a26ba611-c6b3-46e0-a46d-9ae7e32630b5 with Priority: HIGHEST for action port [ 931.724890] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a26ba611-c6b3-46e0-a46d-9ae7e32630b5 with Priority: HIGHEST for action port [ 931.725203] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-a26ba611-c6b3-46e0-a46d-9ae7e32630b5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.725337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a26ba611-c6b3-46e0-a46d-9ae7e32630b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.725423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a26ba611-c6b3-46e0-a46d-9ae7e32630b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.726033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a26ba611-c6b3-46e0-a46d-9ae7e32630b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.726033] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26ba611-c6b3-46e0-a46d-9ae7e32630b5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.759366] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d865462-7646-46f0-875b-9086f535dffe req-274bcb21-2b39-443a-8f3b-c08ebd939c6c service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 931.759366] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d865462-7646-46f0-875b-9086f535dffe req-274bcb21-2b39-443a-8f3b-c08ebd939c6c service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 931.759366] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d865462-7646-46f0-875b-9086f535dffe req-274bcb21-2b39-443a-8f3b-c08ebd939c6c service nova] Enqueued Resource ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with Priority: HIGHEST for action port [ 931.759743] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 931.759818] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 931.759917] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with Priority: HIGHEST for action port [ 931.760414] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.760545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.760613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.761240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.761554] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.762928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.762928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.762928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.763416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.763582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.763681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.763745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.763891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.764064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.764064] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.766211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.766211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.766211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.766211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.766211] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.232198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a26ba611-c6b3-46e0-a46d-9ae7e32630b5 [ 932.232951] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.234279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.234279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.234279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.234279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.234279] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a26ba611-c6b3-46e0-a46d-9ae7e32630b5 already deleted. [ 932.234279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a26ba611-c6b3-46e0-a46d-9ae7e32630b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.266712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.266712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.266712] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.267918] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with status ACTIVE [ 932.267918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.267918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.268320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.268320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.268915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.268915] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.268915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.268915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.270742] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.270742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.270742] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e is going to be updated. [ 932.315818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.316032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.316032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.316287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.316486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.316589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.557699] env[65319]: INFO networking_nsxv3.common.synchronization [req-f0082cfd-0f50-4109-9742-5561db5dd5f9 req-b1774dd4-7bc8-4177-84b9-191067721edf tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 932.558596] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 932.559046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.559198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.559293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.559592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.559831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.559980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.560105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.560345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.560852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.560852] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.773094] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.063923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.064100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.064100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.064294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.064395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.064602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.064695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.064755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.064921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.064993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.065102] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 933.072186] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.072459] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.072521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.072774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.073055] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.073247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.073371] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.073590] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.073734] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.073946] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.074074] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.074217] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.074291] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.074402] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.074503] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.074637] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.098287] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.098510] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 933.100056] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.100056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-57" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.101517] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-e1799b3a-bde1-4a1a-a531-9692c1108da0 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.101818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.101947] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.102335] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.102514] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1799b3a-bde1-4a1a-a531-9692c1108da0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.104724] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.104724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.104724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.104884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.105033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.120784] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 933.143651] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 933.143942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.275917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.276251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.276419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.276689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.276832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.276977] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be created. [ 933.307775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.308190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.308190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.308525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.309061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.319903] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: UNINITIALIZED for 2s [ 933.394189] env[65319]: INFO networking_nsxv3.common.synchronization [req-aefe9352-d70a-406a-945e-951bb70c7417 req-e1907bbb-f48a-47c0-8577-41d5a188b838 tempest-ServerRescueTestJSON-74048994 tempest-ServerRescueTestJSON-74048994-project-member] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 933.394718] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 933.395037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.395204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.395251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.395447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.395617] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.395724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.395787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.395937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.396029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.396221] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.526508] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 933.526640] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 933.526707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.609325] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.609972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.609972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.610457] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.610731] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.610990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port e1799b3a-bde1-4a1a-a531-9692c1108da0 not found, creating... [ 933.611466] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.611769] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.611983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.612391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.612664] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.613589] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.613874] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.614115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.614542] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.614799] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.615120] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: e1799b3a-bde1-4a1a-a531-9692c1108da0 is going to be created. [ 933.644233] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.644456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.644771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.645180] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.645949] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.645949] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.899547] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.259142] env[65319]: INFO networking_nsxv3.common.synchronization [None req-929220e1-999b-45f1-9746-626a0023f173 None None] Enqueued Resource ID: 61c45dc7-5359-4fdc-8bbe-bdeacd9820f1 with Priority: HIGHEST for action port [ 934.259808] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c45dc7-5359-4fdc-8bbe-bdeacd9820f1 with Priority: HIGHEST for action port [ 934.260241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-61c45dc7-5359-4fdc-8bbe-bdeacd9820f1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.260465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61c45dc7-5359-4fdc-8bbe-bdeacd9820f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.260584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61c45dc7-5359-4fdc-8bbe-bdeacd9820f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.260885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61c45dc7-5359-4fdc-8bbe-bdeacd9820f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.260998] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61c45dc7-5359-4fdc-8bbe-bdeacd9820f1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.402455] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.478317] env[65319]: INFO networking_nsxv3.common.synchronization [req-f0082cfd-0f50-4109-9742-5561db5dd5f9 req-69aea025-6194-4898-b229-339bae6d7407 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 934.478556] env[65319]: INFO networking_nsxv3.common.synchronization [req-f0082cfd-0f50-4109-9742-5561db5dd5f9 req-69aea025-6194-4898-b229-339bae6d7407 service nova] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 934.478732] env[65319]: INFO networking_nsxv3.common.synchronization [req-f0082cfd-0f50-4109-9742-5561db5dd5f9 req-69aea025-6194-4898-b229-339bae6d7407 service nova] Enqueued Resource ID: e1799b3a-bde1-4a1a-a531-9692c1108da0 with Priority: HIGHEST for action port [ 934.479946] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_rules [ 934.480052] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 934.480302] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1799b3a-bde1-4a1a-a531-9692c1108da0 with Priority: HIGHEST for action port [ 934.480586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.480790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.480790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.480991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.481090] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.482107] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.482296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.482423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1799b3a-bde1-4a1a-a531-9692c1108da0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.483168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.483263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.483468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.483556] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1799b3a-bde1-4a1a-a531-9692c1108da0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.763969] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61c45dc7-5359-4fdc-8bbe-bdeacd9820f1 [ 934.764514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.764514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.764514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.764805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.764805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.764865] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61c45dc7-5359-4fdc-8bbe-bdeacd9820f1 already deleted. [ 934.764950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61c45dc7-5359-4fdc-8bbe-bdeacd9820f1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.905311] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.905635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.905635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.905635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.905729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.905797] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be updated. [ 934.943418] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.943418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.943748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.946763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.947055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.958091] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 934.986024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.986024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.991366] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1799b3a-bde1-4a1a-a531-9692c1108da0 with status ACTIVE [ 934.992273] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.994026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.994223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.994410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.994504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.994741] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.994857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.994945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.995166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.995253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.995472] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.995805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.995805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.995805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.995954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.995954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1799b3a-bde1-4a1a-a531-9692c1108da0 is going to be updated. [ 935.024674] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.024899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.025220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.025851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.025851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.025851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1799b3a-bde1-4a1a-a531-9692c1108da0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.130407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 935.130602] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 935.130719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.130891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.131192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.131348] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.131470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.131534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.131703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.131785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.131881] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.333014] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 935.333014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.333014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.333333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.333700] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.333850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.333957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.334175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.334921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.334921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.334921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.636117] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.836976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.837281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.837507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.837823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.838331] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.838331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.838551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.839082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.839082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.839082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.839379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.839379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.839495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.840434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.840720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.840935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.841099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.841273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.841475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.841569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.841826] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.139622] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.344140] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57b692c1-c9a8-4318-94f5-2184ff1f58ef: rpc.has_security_group_logging(os_id): False [ 936.363350] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.363511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.363561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.363835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.363952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.364179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.364292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.364353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.364555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.364632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.364960] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.365031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.365101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.365280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.365365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.365571] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.365694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.365750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.365933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.366037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.366117] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be created. [ 936.429418] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.429622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.429695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.429939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.430229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.443755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 936.641141] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.642692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.642692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.642692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.642692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.642692] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 936.676708] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.676708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.676994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.677340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.677651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.688996] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 936.968920] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 936.968920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.489981] env[65319]: INFO networking_nsxv3.common.synchronization [req-137619fe-362b-4ab3-854e-c0d2d49a873a req-afa42e59-9818-4b6c-a26a-6c6c8e9f249f tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 937.490562] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 937.490889] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.491033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.491083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.491309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.491472] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.491596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.491659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.491813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.491910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.492012] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.993997] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.459128] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 938.459128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.499037] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.701270] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 938.701845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.701845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.701993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.702243] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.702382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.704555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.704764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.704858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.704959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.705069] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.001663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.001826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.001900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.002147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.002268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.002381] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 939.033715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.033715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.033715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.033715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.033715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.046242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 939.207823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.208459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.208459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.208459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.208663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.208663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.208663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.208828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.208882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.208966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.209179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.209296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.209296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.209484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.209722] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.209722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.209722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.209986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.210539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.210714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.210828] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.714113] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d51d74c1-0bc9-4f08-9e69-0f36720ce33b: rpc.has_security_group_logging(os_id): False [ 939.734841] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.735419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.735419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.735419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.735621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.735765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.735823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.735860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.736066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.736168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.736601] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.736601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.736601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.736759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.736811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.737084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.737244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.737285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.737434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.737512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.737602] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 939.834929] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.835321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.835424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.835708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.835830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.854523] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 941.056455] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 941.057297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.873375] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 941.873541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.491694] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 942.492101] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 943.306188] env[65319]: INFO networking_nsxv3.common.synchronization [req-f1723056-6c9a-4efb-9dba-d5b532755f4f req-b2123d9b-07d9-41dd-9690-2d4206a8a6bb tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 943.306888] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 943.307584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.307731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.308165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.308267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.308676] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.308676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.308676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.308898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.309042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.309198] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.812893] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.812893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.812893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.812893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.812893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.813531] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.813531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.813531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.813658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.813799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.813799] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 already deleted. [ 943.814137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.888786] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.889099] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.889292] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.889712] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.890056] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.890298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.890471] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.890963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.891176] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.891479] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.891727] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.891919] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.892737] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.892815] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.892960] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.893140] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.920391] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.923211] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.923211] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.923211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.923211] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-e41913b2-c6ef-4026-a6ea-01645e1574d7 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.923211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.923211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.923211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.923855] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41913b2-c6ef-4026-a6ea-01645e1574d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.430551] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.430551] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port e41913b2-c6ef-4026-a6ea-01645e1574d7 not found, creating... [ 944.430551] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.430551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.431055] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.431055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.431985] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.432172] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.432318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.432462] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: e41913b2-c6ef-4026-a6ea-01645e1574d7 is going to be created. [ 944.454499] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.455305] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.455586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.455970] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.456341] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.456684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.183253] env[65319]: INFO networking_nsxv3.common.synchronization [req-f1723056-6c9a-4efb-9dba-d5b532755f4f req-85054ccc-a2b8-4761-a059-72d24ecdcd57 service nova] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 945.183559] env[65319]: INFO networking_nsxv3.common.synchronization [req-f1723056-6c9a-4efb-9dba-d5b532755f4f req-85054ccc-a2b8-4761-a059-72d24ecdcd57 service nova] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 945.183559] env[65319]: INFO networking_nsxv3.common.synchronization [req-f1723056-6c9a-4efb-9dba-d5b532755f4f req-85054ccc-a2b8-4761-a059-72d24ecdcd57 service nova] Enqueued Resource ID: e41913b2-c6ef-4026-a6ea-01645e1574d7 with Priority: HIGHEST for action port [ 945.184095] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_rules [ 945.184247] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 945.184346] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41913b2-c6ef-4026-a6ea-01645e1574d7 with Priority: HIGHEST for action port [ 945.184659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.184789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.184858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.185064] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.185190] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.186053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.186176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.186253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.186496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.186702] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.186761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.186826] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.186974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.187072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.187165] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.187958] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e41913b2-c6ef-4026-a6ea-01645e1574d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.188108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.188171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.188320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.188436] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41913b2-c6ef-4026-a6ea-01645e1574d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.444318] env[65319]: INFO networking_nsxv3.common.synchronization [req-1fda21c7-fe08-47c1-9e8f-b1228a4877a5 req-8db4c49b-d0b0-4fcd-a667-aea7d371d50d tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 945.444318] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 945.444536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.444651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.444715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.444916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.445234] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.445234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.445366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.445464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.445574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.445669] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.671991] env[65319]: INFO networking_nsxv3.common.synchronization [req-b9139442-1462-4c9e-a5e5-cd62d177ff7c req-d4978d9b-784f-4491-9e79-9e9adf47f2ea tempest-ListServersNegativeTestJSON-1321398481 tempest-ListServersNegativeTestJSON-1321398481-project-member] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 945.671991] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGHEST for action security_group_members [ 945.674216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.674632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.696256] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.696256] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.696256] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e41913b2-c6ef-4026-a6ea-01645e1574d7 with status ACTIVE [ 945.696256] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.696256] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.696256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.696858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.696858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.696858] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.697413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.697413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.697413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.697413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.697413] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e41913b2-c6ef-4026-a6ea-01645e1574d7 is going to be updated. [ 945.699471] env[65319]: INFO networking_nsxv3.common.synchronization [None req-666cdfaf-d5c5-427b-858f-0caa3726bdb5 None None] Enqueued Resource ID: b7c02d61-23e6-469d-a41c-17c41ee7994e with Priority: HIGHEST for action port [ 945.700672] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c02d61-23e6-469d-a41c-17c41ee7994e with Priority: HIGHEST for action port [ 945.702316] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7c02d61-23e6-469d-a41c-17c41ee7994e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.702395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7c02d61-23e6-469d-a41c-17c41ee7994e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.702454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7c02d61-23e6-469d-a41c-17c41ee7994e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.702789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7c02d61-23e6-469d-a41c-17c41ee7994e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.702906] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7c02d61-23e6-469d-a41c-17c41ee7994e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.725939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.726117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.726720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.726720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.726720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.726905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e41913b2-c6ef-4026-a6ea-01645e1574d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.950273] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.200879] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.205227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7c02d61-23e6-469d-a41c-17c41ee7994e [ 946.205227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.205227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.205227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.206853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.206853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.206853] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7c02d61-23e6-469d-a41c-17c41ee7994e already deleted. [ 946.207018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7c02d61-23e6-469d-a41c-17c41ee7994e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.209489] env[65319]: INFO networking_nsxv3.common.synchronization [req-7d64669f-9f70-427e-9ed4-ef699db9e9b3 req-087bd081-4335-484f-8ed2-bf92c50ffbe6 tempest-ServerMetadataTestJSON-1590710980 tempest-ServerMetadataTestJSON-1590710980-project-member] Enqueued Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 946.210190] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 946.210621] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.210808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.210926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.211310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.212570] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.212570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.212570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.212570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.212823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.212823] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.455053] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.585699] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.585892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-94" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.586018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-94" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.586421] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-94" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.586678] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.586857] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.586955] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.587210] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.587350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.587561] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.587675] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.587778] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.587885] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.587994] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.588107] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.588241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.608064] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.608265] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.608425] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.608589] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-94" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.608976] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-28d768e8-d13a-4164-bcd0-132062458fff taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.609741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.609741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.609741] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.609741] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d768e8-d13a-4164-bcd0-132062458fff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.703201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.703373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.703438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.703656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.703815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.703925] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 is going to be created. [ 946.718100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.718100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.718100] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 already deleted. [ 946.718100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.738753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.738952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.738952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.739314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.739510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.754223] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: UNINITIALIZED for 2s [ 946.958902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.958902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.958902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.958902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.958902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.958902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 946.993205] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.993419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.993512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.993811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.994035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.005366] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 947.116024] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.116691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.116691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.117361] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.117612] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.117824] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 28d768e8-d13a-4164-bcd0-132062458fff not found, creating... [ 947.118220] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.118397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.118513] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.118758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.118901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.119228] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.119394] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.119512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.119804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.119935] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.120108] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 28d768e8-d13a-4164-bcd0-132062458fff is going to be created. [ 947.147698] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.147915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.148041] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.148322] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.148551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.148775] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.905147] env[65319]: INFO networking_nsxv3.common.synchronization [req-7d64669f-9f70-427e-9ed4-ef699db9e9b3 req-fd614a6d-8034-469a-9212-1a000b18a6c0 service nova] Enqueued Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_rules [ 947.905147] env[65319]: INFO networking_nsxv3.common.synchronization [req-7d64669f-9f70-427e-9ed4-ef699db9e9b3 req-fd614a6d-8034-469a-9212-1a000b18a6c0 service nova] Enqueued Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 947.906711] env[65319]: INFO networking_nsxv3.common.synchronization [req-7d64669f-9f70-427e-9ed4-ef699db9e9b3 req-fd614a6d-8034-469a-9212-1a000b18a6c0 service nova] Enqueued Resource ID: 28d768e8-d13a-4164-bcd0-132062458fff with Priority: HIGHEST for action port [ 947.907300] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_rules [ 947.907430] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 947.907584] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28d768e8-d13a-4164-bcd0-132062458fff with Priority: HIGHEST for action port [ 947.908330] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.908460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.908523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.908956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.908956] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.910399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.910526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.910598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.910774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.910926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.911030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.911088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.911230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.911381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.911381] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.914750] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-28d768e8-d13a-4164-bcd0-132062458fff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.914750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.914750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.914942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.914942] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d768e8-d13a-4164-bcd0-132062458fff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.411677] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.411953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.415523] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.416514] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28d768e8-d13a-4164-bcd0-132062458fff with status ACTIVE [ 948.416709] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.418186] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.418186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.418421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.418421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.420225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.420225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.420225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.420225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.420225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.420225] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28d768e8-d13a-4164-bcd0-132062458fff is going to be updated. [ 948.443179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.443393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.443511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.443646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.443783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.443939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28d768e8-d13a-4164-bcd0-132062458fff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.490025] env[65319]: INFO networking_nsxv3.common.synchronization [None req-c60ebc8f-7443-4eb2-b931-bb428ad12b7a None None] Enqueued Resource ID: 502aac11-62f7-4bf0-985f-9b58527cb8e2 with Priority: HIGHEST for action port [ 948.490025] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 502aac11-62f7-4bf0-985f-9b58527cb8e2 with Priority: HIGHEST for action port [ 948.490682] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-502aac11-62f7-4bf0-985f-9b58527cb8e2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.491027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-502aac11-62f7-4bf0-985f-9b58527cb8e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.491027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-502aac11-62f7-4bf0-985f-9b58527cb8e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.491727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-502aac11-62f7-4bf0-985f-9b58527cb8e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.491727] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502aac11-62f7-4bf0-985f-9b58527cb8e2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.767314] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: UNINITIALIZED for 4s [ 948.921628] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.994772] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 502aac11-62f7-4bf0-985f-9b58527cb8e2 [ 948.995015] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.995253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.995253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.995463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.995555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.995649] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:502aac11-62f7-4bf0-985f-9b58527cb8e2 already deleted. [ 948.995765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-502aac11-62f7-4bf0-985f-9b58527cb8e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.016443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 949.016734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.016914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.017150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.017355] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.017490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.017547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.017677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.017757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.017853] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.427183] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.427183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.427183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.427183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.427183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.427183] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 is going to be created. [ 949.458034] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.458034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.458259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.458341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.458496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.470337] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: UNINITIALIZED for 2s [ 949.520019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.520233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.520276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.520506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.520604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.520818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.520924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.521016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.521268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.521403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.521526] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be updated. [ 949.550536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.550724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.550766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.550967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.551183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.561041] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: IN_PROGRESS for 2s [ 950.786074] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: SUCCESS [ 950.786476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.786519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.786724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.787643] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.787643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.787643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.787643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.787643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.787643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.787643] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.890057] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-e65930a3-5b60-4fef-9267-463bcd7ae0d8 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 950.890726] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 950.891093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.894126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.894126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.894126] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.955093] env[65319]: INFO networking_nsxv3.common.synchronization [req-22e4a071-0e3c-440d-9de1-7262d4d26354 req-c9f2c0eb-ba0f-43a5-a9c7-8c2e9ffb599f tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 950.955681] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 950.956022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.957292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.957374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.957642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.957834] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.957957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.958041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.958203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.958310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.958411] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.207207] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-defaa269-39c1-475c-a265-f33bca3e9c06 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 951.207844] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 951.208116] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.208231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.289462] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.323180] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.323414] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.323539] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.323806] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.324078] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.324237] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.324353] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.324758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.324758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.324916] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.325058] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.325196] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.325316] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.325477] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.325592] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.325726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.346034] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.346238] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.346542] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.347456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.347456] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-847e25f7-2cae-4890-bef7-b8e39e7f9631 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.347456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.347725] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.348823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.348823] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847e25f7-2cae-4890-bef7-b8e39e7f9631',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.395241] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.395487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.395582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.395818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.395998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.396181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.396288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.396351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.396517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.396597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.396712] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea already deleted. [ 951.396803] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.397572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.397821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.398102] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.398263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.398368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.398568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.398738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.398856] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.462108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.462345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.462345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.462547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.462635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.462838] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.462937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.462999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.463197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.463287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.463346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f already deleted. [ 951.463426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.481380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: SUCCESS [ 951.481635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.481812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.482133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.482367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.482510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.482561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.482747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.482837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.482925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.483025] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.574288] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4334772-46a4-4ed8-9e08-70d20fdec313 in Status: SUCCESS [ 951.574561] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 deletion is rescheduled due to dependency. [ 951.574687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.674535] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-926cad6a-fc35-4de4-adef-82afbfcd3c91 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 951.675090] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 951.675406] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.675502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.792607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6b09724-e475-4a72-9a9a-5f9d496d4627: rpc.has_security_group_logging(os_id): False [ 951.811661] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.811873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.811873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.812104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.812191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.812484] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.812602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.812684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.812848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.812926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.813019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 is going to be created. [ 951.851018] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.851339] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.851494] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.851782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.852073] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.852336] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 847e25f7-2cae-4890-bef7-b8e39e7f9631 not found, creating... [ 951.852649] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.852896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.853053] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.853325] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.853470] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.853799] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.853957] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.854115] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.854323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.854554] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.854700] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 847e25f7-2cae-4890-bef7-b8e39e7f9631 is going to be created. [ 951.874478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.874635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.874703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.875069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.875333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.877506] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.877654] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.877752] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.878044] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.878350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.878581] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.888642] env[65319]: INFO networking_nsxv3.common.synchronization [req-5e57cb6f-e925-4f92-bdf1-bd04d32b647a req-a95244af-e1b0-447e-b4db-98f7a9e76d27 tempest-ServerRescueTestJSON-74048994 tempest-ServerRescueTestJSON-74048994-project-member] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 951.889333] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGHEST for action security_group_members [ 951.889666] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.889793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.889858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.890289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.890289] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.890386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.890417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.890576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.890667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.890796] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.892415] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: IN_PROGRESS for 2s [ 951.901480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.901669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.901722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.901906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.901993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.902190] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.902290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.902350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.902622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.902732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.902827] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea already deleted. [ 951.902909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.903414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.903576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.903732] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.903879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.903940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.904053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.904148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.904259] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.986058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.986058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.986058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.986451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.986540] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.986722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.986846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.987151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.987270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.987443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.987711] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.987881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.987999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.988268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.988553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.988679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.988783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.989520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.989520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.989520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.989520] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.213278] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.213486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.213608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.214058] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.214356] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.214525] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.214642] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.214873] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.215040] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.215426] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.215582] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.215582] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.215699] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.215767] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.215877] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.216019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.243619] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.243824] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.243990] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.244232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.244646] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-cdca7d3d-749f-43da-a1d5-603afbc56770 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.244870] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.245030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.245538] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.245716] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdca7d3d-749f-43da-a1d5-603afbc56770',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.393935] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.394168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.394225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.394434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.394530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.394769] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.394920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.394988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.395235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.395345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.395404] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be updated. [ 952.406548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.406754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.406848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.407154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.407294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.407606] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.407671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.407736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.407909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.407994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.408120] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea already deleted. [ 952.408232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.431110] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.431319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.431365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.431607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.431982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.455604] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: IN_PROGRESS for 2s [ 952.492056] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1: rpc.has_security_group_logging(os_id): False [ 952.511981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.512145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.512242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.512503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.512609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.512812] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.512956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.513012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.513166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.513248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.513536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.513675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.513721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.513881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.513955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.515821] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.515821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.515821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.515821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.515821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.515821] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 is going to be created. [ 952.579355] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.579553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.579553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.579817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.579947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.605286] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: IN_PROGRESS for 2s [ 952.638639] env[65319]: INFO networking_nsxv3.common.synchronization [req-22e4a071-0e3c-440d-9de1-7262d4d26354 req-9944d8ed-4548-44a0-9ceb-8e3f13673ed4 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 952.638912] env[65319]: INFO networking_nsxv3.common.synchronization [req-22e4a071-0e3c-440d-9de1-7262d4d26354 req-9944d8ed-4548-44a0-9ceb-8e3f13673ed4 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 952.638992] env[65319]: INFO networking_nsxv3.common.synchronization [req-22e4a071-0e3c-440d-9de1-7262d4d26354 req-9944d8ed-4548-44a0-9ceb-8e3f13673ed4 service nova] Enqueued Resource ID: 847e25f7-2cae-4890-bef7-b8e39e7f9631 with Priority: HIGHEST for action port [ 952.639625] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 952.639784] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 952.639873] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847e25f7-2cae-4890-bef7-b8e39e7f9631 with Priority: HIGHEST for action port [ 952.640148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.640369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.640433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.640790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.640790] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.641837] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.641937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.641937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.642151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.642299] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.642399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.642461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.642605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.642691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.642785] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.643679] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-847e25f7-2cae-4890-bef7-b8e39e7f9631 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.643813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.643998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.644118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.644332] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847e25f7-2cae-4890-bef7-b8e39e7f9631',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.750377] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.750377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.750377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.750377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.750377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.750901] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port cdca7d3d-749f-43da-a1d5-603afbc56770 not found, creating... [ 952.750961] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.751233] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.751348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.751661] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.751774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.752054] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.752224] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.752376] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.752586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.752724] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.753013] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: cdca7d3d-749f-43da-a1d5-603afbc56770 is going to be created. [ 952.779039] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.779362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.779502] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.779784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.780019] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.780243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.146052] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.147412] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.147704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.147946] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 847e25f7-2cae-4890-bef7-b8e39e7f9631 with status ACTIVE [ 953.148188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.148275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.148391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.148540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.149044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.149044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.149044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.149044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.149593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.149593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.149593] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.149727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.149727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.149877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.149956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.150055] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 847e25f7-2cae-4890-bef7-b8e39e7f9631 is going to be updated. [ 953.170730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.170887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.170953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.171155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.171417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.171503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847e25f7-2cae-4890-bef7-b8e39e7f9631" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.332082] env[65319]: INFO networking_nsxv3.common.synchronization [req-39c0ccde-8438-42c7-9ef7-81a3fe903021 req-71311def-b17d-4f74-bc53-784af74840e4 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 953.332723] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 953.333068] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.333244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.333347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.333682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.333847] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.333951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.334023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.334177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.334266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.334362] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.494466] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-5bcf52e0-b369-4ae1-a1eb-22b6536e9583 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 953.494466] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-5bcf52e0-b369-4ae1-a1eb-22b6536e9583 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 953.494600] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-5bcf52e0-b369-4ae1-a1eb-22b6536e9583 service nova] Enqueued Resource ID: cdca7d3d-749f-43da-a1d5-603afbc56770 with Priority: HIGHEST for action port [ 953.495137] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 953.495661] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 953.495793] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdca7d3d-749f-43da-a1d5-603afbc56770 with Priority: HIGHEST for action port [ 953.496102] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.496229] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.496341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.496645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.496732] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.497673] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.497817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.498565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.498565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.498565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.498565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.498565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.498565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.498827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.498827] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.500589] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdca7d3d-749f-43da-a1d5-603afbc56770 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.500589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.500589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.500589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.500589] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdca7d3d-749f-43da-a1d5-603afbc56770',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.648450] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.689081] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.689358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.689527] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.689846] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.690157] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.690320] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.690456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.690661] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.690813] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.690994] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.691128] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.691237] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.691348] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.691459] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.691567] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.691700] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.721099] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.721291] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.721416] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.722167] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.722167] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-e0b802fa-65dc-475a-8615-c479b5086a6f taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.722167] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.722167] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.722567] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.722729] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b802fa-65dc-475a-8615-c479b5086a6f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.836829] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.837069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.837204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.837461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.837591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.837863] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.838022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.838107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.838343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.838456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.838575] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 953.869980] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.870215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.870313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.870598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.870786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.881031] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 953.904465] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: SUCCESS [ 953.904465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.001801] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.001955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.002736] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.003103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdca7d3d-749f-43da-a1d5-603afbc56770 with status ACTIVE [ 954.003327] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.003454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.003512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.003714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.003799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.003970] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.004079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.004141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.004289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.004367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.004546] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.004638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.004698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.004843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.004917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.004999] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdca7d3d-749f-43da-a1d5-603afbc56770 is going to be updated. [ 954.029575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.029822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.029877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.031044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.031044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.031044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdca7d3d-749f-43da-a1d5-603afbc56770" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.154211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.154211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.154211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.154211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.154211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.154211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be created. [ 954.179297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.179475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.179521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.179766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.179956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.190854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: UNINITIALIZED for 2s [ 954.225359] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.226232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.226232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.226232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.226433] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.226554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port e0b802fa-65dc-475a-8615-c479b5086a6f not found, creating... [ 954.226879] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.227065] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.227191] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.227432] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.227781] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.228362] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.228510] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.228692] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.229015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.229236] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.229454] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: e0b802fa-65dc-475a-8615-c479b5086a6f is going to be created. [ 954.261864] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.262774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.262774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.262774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.262774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.263205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.343144] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.343407] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-827" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.343536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-827" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.343876] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-827" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.344173] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.344344] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.344479] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.344704] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.344853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.345079] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.345223] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.345336] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.345450] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.345562] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.345670] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.345800] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.375489] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.375799] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.376037] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.376344] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-827" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.376750] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-2a46cfff-6f04-4264-93a5-e3e553d8b774 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.377015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.377205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.377592] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.377791] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a46cfff-6f04-4264-93a5-e3e553d8b774',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.465041] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc in Status: SUCCESS [ 954.465041] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc deletion is rescheduled due to dependency. [ 954.465246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.507354] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.620446] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: SUCCESS [ 954.620734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.880688] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.880937] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.881074] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.881372] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.881526] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.881679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 2a46cfff-6f04-4264-93a5-e3e553d8b774 not found, creating... [ 954.881943] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.882117] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.882232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.882451] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.882609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.882935] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.883202] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.883351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.883596] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.883749] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.883940] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 2a46cfff-6f04-4264-93a5-e3e553d8b774 is going to be created. [ 954.909389] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.909686] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.909742] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.909996] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.910238] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.910463] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.972608] env[65319]: INFO networking_nsxv3.common.synchronization [req-39c0ccde-8438-42c7-9ef7-81a3fe903021 req-d423b6ba-fd91-4668-ba4e-86772c6dc441 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 954.972808] env[65319]: INFO networking_nsxv3.common.synchronization [req-39c0ccde-8438-42c7-9ef7-81a3fe903021 req-d423b6ba-fd91-4668-ba4e-86772c6dc441 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 954.972946] env[65319]: INFO networking_nsxv3.common.synchronization [req-39c0ccde-8438-42c7-9ef7-81a3fe903021 req-d423b6ba-fd91-4668-ba4e-86772c6dc441 service nova] Enqueued Resource ID: e0b802fa-65dc-475a-8615-c479b5086a6f with Priority: HIGHEST for action port [ 954.973544] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 954.973663] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 954.973762] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0b802fa-65dc-475a-8615-c479b5086a6f with Priority: HIGHEST for action port [ 954.974061] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.974187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.974246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.974450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.974533] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.977431] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.977529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.977849] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0b802fa-65dc-475a-8615-c479b5086a6f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.977849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.977986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.978116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.978852] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b802fa-65dc-475a-8615-c479b5086a6f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.010557] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.010557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.010557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.010557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.010557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.010892] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be created. [ 955.043384] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.043521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.043560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.043765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.043921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.053739] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: UNINITIALIZED for 2s [ 955.480047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.481458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.481458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0b802fa-65dc-475a-8615-c479b5086a6f with status ACTIVE [ 955.481458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.481458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.481458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.481703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.481784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.482433] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.482433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.482433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.482433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.482433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.482776] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.482776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.482876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.483027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.483123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.483229] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0b802fa-65dc-475a-8615-c479b5086a6f is going to be updated. [ 955.506710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.507644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.507644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.507644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.507644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.507848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0b802fa-65dc-475a-8615-c479b5086a6f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.632174] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-85769a7c-4ed2-426f-b20d-a15ec558640e service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 955.632368] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-85769a7c-4ed2-426f-b20d-a15ec558640e service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 955.632929] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-85769a7c-4ed2-426f-b20d-a15ec558640e service nova] Enqueued Resource ID: 2a46cfff-6f04-4264-93a5-e3e553d8b774 with Priority: HIGHEST for action port [ 955.633139] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 955.633284] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 955.633377] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a46cfff-6f04-4264-93a5-e3e553d8b774 with Priority: HIGHEST for action port [ 955.633688] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.633792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.634012] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.634103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.634798] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a46cfff-6f04-4264-93a5-e3e553d8b774 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.634921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.634991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.635265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.635395] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a46cfff-6f04-4264-93a5-e3e553d8b774',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.893239] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 955.893512] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 955.893660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.893746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.893967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.894175] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.894323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.894388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.894596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.894651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.894713] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.138377] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a46cfff-6f04-4264-93a5-e3e553d8b774 with status ACTIVE [ 956.138694] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.138855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.138946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.139228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.139357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.139577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.139707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.139793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.140198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.140198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.140377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.140523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.140605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.140776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.140875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.140970] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a46cfff-6f04-4264-93a5-e3e553d8b774 is going to be updated. [ 956.166918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.167094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.167171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.167447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.167630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.167879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a46cfff-6f04-4264-93a5-e3e553d8b774" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.202275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 956.202498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.202685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.202968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.203226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.203375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.203445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.203605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.203688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.203827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.203936] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.396823] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.462903] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.463219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.463355] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.463647] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.463943] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.464107] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.464236] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.464517] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.464709] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.464922] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.465091] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.465259] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.465378] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.465524] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.465661] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.465821] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.486467] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.486467] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.486467] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.486467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-888" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486863] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-ccf173ac-b9d2-4e32-ae3f-068177781007 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.486863] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.486863] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.487184] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.487392] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf173ac-b9d2-4e32-ae3f-068177781007',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.706763] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.707084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.707084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.708035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.708035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.708035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.708561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.708561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.708561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.708561] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.708836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.708836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.708836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.708971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.708971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.709122] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.899960] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.990891] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.991674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.991857] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.992195] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.992403] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.992589] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port ccf173ac-b9d2-4e32-ae3f-068177781007 not found, creating... [ 956.992798] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.992995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.993160] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993412] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.993979] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.994391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.994391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.994496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.994646] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.994791] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: ccf173ac-b9d2-4e32-ae3f-068177781007 is going to be created. [ 957.017853] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.017853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.017853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.017853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.017853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.017853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.075879] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 957.076072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.076163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.076475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.076971] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.076971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.076971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.077203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.077203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.077306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.077418] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.078848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.078848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.078978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.079069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.079121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.079283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.079387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.079545] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.214386] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd590ec-aafc-4836-92d2-a1ad91f3849f: rpc.has_security_group_logging(os_id): False [ 957.240104] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.240246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.240366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.240685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.240864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.241216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.241398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.241507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.241719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.241839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.242132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.242276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.242382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.242588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.242693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.242950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.243153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.243263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.243372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.243481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.243606] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be created. [ 957.371521] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.371521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.371521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.371521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.371521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.387238] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 957.403072] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.403270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.403270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.404161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.404161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.404161] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 957.458725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.458725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.458725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.458725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.458725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.468204] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 957.581317] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.583202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.583202] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.753019] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-14e9e671-58a8-4e50-b758-042bd119dfe8 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 957.753019] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-14e9e671-58a8-4e50-b758-042bd119dfe8 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 957.753019] env[65319]: INFO networking_nsxv3.common.synchronization [req-d89ae0d6-07e8-4392-a123-e50fcc333d34 req-14e9e671-58a8-4e50-b758-042bd119dfe8 service nova] Enqueued Resource ID: ccf173ac-b9d2-4e32-ae3f-068177781007 with Priority: HIGHEST for action port [ 957.753019] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 957.753019] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 957.753252] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf173ac-b9d2-4e32-ae3f-068177781007 with Priority: HIGHEST for action port [ 957.753875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.753875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.753875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.753875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.753875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccf173ac-b9d2-4e32-ae3f-068177781007 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.754147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.754147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.754253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.754294] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf173ac-b9d2-4e32-ae3f-068177781007',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.088471] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.256030] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccf173ac-b9d2-4e32-ae3f-068177781007 with status ACTIVE [ 958.256304] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.256427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.256528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.256769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.256825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.257041] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.257206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.257236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.257390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.257482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.257705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.257823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.257889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.258060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.258140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.258264] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccf173ac-b9d2-4e32-ae3f-068177781007 is going to be updated. [ 958.280920] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.281208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.281384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.282131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.282131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.282131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccf173ac-b9d2-4e32-ae3f-068177781007" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.590693] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.591011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.591011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.591174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.591275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.591511] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 958.621045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.621208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.621208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.621434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.621722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.632527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 959.161660] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 959.162856] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 959.162856] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 959.162856] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 959.162856] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.163015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.163015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.163958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.163958] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.163958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.164135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.164305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.164448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.164538] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.166127] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f216114-266a-41e4-8c9e-40f72b06dd73 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.166248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.166332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.166590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.167440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.167673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.167738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.168034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.168718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.169348] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.221175] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_rules [ 959.221844] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [req-93380941-32ca-4b63-bffc-4340e432af30 req-0c8081ce-0836-4984-81b8-083cc8aee55c tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_rules [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 959.223229] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 959.223486] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 959.223665] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f216114-266a-41e4-8c9e-40f72b06dd73 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.224408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.224532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.224855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.224977] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.226067] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.226257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.226397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.226575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.227431] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.229051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fedbfd-0eeb-4e3d-9243-17768c37be03 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.229051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.229051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.229051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.229051] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fedbfd-0eeb-4e3d-9243-17768c37be03',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.230054] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f216114-266a-41e4-8c9e-40f72b06dd73 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.230179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.230435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.230706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.402560] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 959.402560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.479840] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 959.480135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.480423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.480662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.480900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.481055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.481135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.481353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.481353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.481488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.481535] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.672377] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.673926] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.735029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79fedbfd-0eeb-4e3d-9243-17768c37be03 with status ACTIVE [ 959.735029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.735029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.735029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.735029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.735029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 is going to be updated. [ 959.735743] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.736580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.736999] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f216114-266a-41e4-8c9e-40f72b06dd73 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.737315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.760765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.760944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.761018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.761288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.761366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.761521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.851584] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e147ae1a-3862-4a9c-9348-9043c20bd494 None None] Enqueued Resource ID: cb95e041-5427-4b28-9fb7-c51d6590aa83 with Priority: HIGHEST for action port [ 959.852527] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb95e041-5427-4b28-9fb7-c51d6590aa83 with Priority: HIGHEST for action port [ 959.852655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb95e041-5427-4b28-9fb7-c51d6590aa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.852764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb95e041-5427-4b28-9fb7-c51d6590aa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.852846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb95e041-5427-4b28-9fb7-c51d6590aa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.853312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb95e041-5427-4b28-9fb7-c51d6590aa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.853312] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb95e041-5427-4b28-9fb7-c51d6590aa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.987694] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.987914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.987914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.988196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.988339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.988565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.988565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.988664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.988923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.988923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.989097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.989181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.989245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.989941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.990134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.990201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.990363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.990727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.990727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.990727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.990879] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.280208] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.281521] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.286329] env[65319]: INFO networking_nsxv3.common.synchronization [req-17907d19-11f6-46ef-88a2-9775355630e9 req-3ff058a1-0087-4bba-9f61-78965ae5df45 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 960.286329] env[65319]: INFO networking_nsxv3.common.synchronization [req-17907d19-11f6-46ef-88a2-9775355630e9 req-3ff058a1-0087-4bba-9f61-78965ae5df45 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 960.286329] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 960.286329] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 with Priority: HIGHEST for action security_group_members [ 960.286329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.286329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.286329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f216114-266a-41e4-8c9e-40f72b06dd73 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.286329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.297901] env[65319]: INFO networking_nsxv3.common.synchronization [req-17907d19-11f6-46ef-88a2-9775355630e9 req-3ff058a1-0087-4bba-9f61-78965ae5df45 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 960.298093] env[65319]: INFO networking_nsxv3.common.synchronization [req-17907d19-11f6-46ef-88a2-9775355630e9 req-3ff058a1-0087-4bba-9f61-78965ae5df45 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 960.298251] env[65319]: INFO networking_nsxv3.common.synchronization [req-17907d19-11f6-46ef-88a2-9775355630e9 req-3ff058a1-0087-4bba-9f61-78965ae5df45 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 960.299882] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_rules [ 960.299882] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 960.299882] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 with Priority: HIGHEST for action port [ 960.299882] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.299882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.299882] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.299882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.300575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fedbfd-0eeb-4e3d-9243-17768c37be03 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.300575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.300575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.300575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.300575] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fedbfd-0eeb-4e3d-9243-17768c37be03',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.359112] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb95e041-5427-4b28-9fb7-c51d6590aa83 [ 960.359331] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.359587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.360430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.360430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.360430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.360430] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb95e041-5427-4b28-9fb7-c51d6590aa83 already deleted. [ 960.360430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb95e041-5427-4b28-9fb7-c51d6590aa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.496904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 960.527592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.527752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.527823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.528052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.528144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.528458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.528619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.528747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.528974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.529560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.529867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.530167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.530223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.530421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.530646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.530910] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.531171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.531171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.531304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.531388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.531481] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 960.622585] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.623127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.623473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.623764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.623933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.658287] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 960.658287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.658412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.658736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.659057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.659255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.660036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.660036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.660036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.660036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.660036] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.662898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.663105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.663427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.664822] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.665113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.665295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.665647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.666230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.666480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.666709] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.669537] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 960.669979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.672616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.672616] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.672616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.672616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.672616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.672616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.672616] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.785597] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.785597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.785597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.785597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.785597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.785597] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 is going to be created. [ 960.786842] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.786983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.787656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.790476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.791280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.791280] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 960.803298] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79fedbfd-0eeb-4e3d-9243-17768c37be03 with status ACTIVE [ 960.804476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.804476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.804476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.804476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.804735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.804886] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.805074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.805142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.805386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.805473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.805703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.805812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.805869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.806117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.806206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.806335] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79fedbfd-0eeb-4e3d-9243-17768c37be03 is going to be updated. [ 960.866069] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.868110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.868110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.868110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.868110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.870130] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.870302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.870419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.870753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.870951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.871516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fedbfd-0eeb-4e3d-9243-17768c37be03" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.872696] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.872834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.872902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.873140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.873313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.884458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 960.885866] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 in Status: UNINITIALIZED for 2s [ 961.175078] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f47eb94-bdf5-494d-a378-78951389d1ea: rpc.has_security_group_logging(os_id): False [ 961.176390] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.201439] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.201767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.201767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.201963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.202112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.202363] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.202493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.202602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.202708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.202794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.202985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.203525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.203643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.203746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.203833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.204035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.204184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.204184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.204433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.204505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.204705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be created. [ 961.282077] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.282077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.282077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.282077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.282077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.299555] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 961.663599] env[65319]: INFO networking_nsxv3.common.synchronization [req-53d0d3b4-af02-4952-b572-98c3a3b87b1a req-5e9ef12f-f4a0-4865-85a4-0795009a4246 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 961.664478] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGHEST for action security_group_members [ 961.665662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.665662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.665662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.665662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.665901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.665957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.666024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.666519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.666519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.666519] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.680651] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.156150] env[65319]: INFO networking_nsxv3.common.synchronization [req-6dfa3b72-75e5-442e-88ef-92e33a6d6a9d req-bb04c7c7-5ab0-48d3-9d6c-d17272181432 tempest-ServersNegativeTestJSON-1277425665 tempest-ServersNegativeTestJSON-1277425665-project-member] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 962.156758] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 962.156990] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.157427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.157523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.157750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.158641] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.158763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.158834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.159044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.159205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.159377] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.163499] env[65319]: INFO networking_nsxv3.common.synchronization [req-389a1b71-73ee-415c-aded-fe785eb0ad39 req-ed0d503b-da2b-49c2-bd70-c8b19f5a0a6a tempest-ServersAdminTestJSON-706928480 tempest-ServersAdminTestJSON-706928480-project-member] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 962.164642] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGHEST for action security_group_members [ 962.166900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.166900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.166900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.167328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.167328] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.171093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.171093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.171274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.171326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.171533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.171735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.171832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.171894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.172252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.172354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.173032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 is going to be updated. [ 962.184103] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.184376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.184500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.184838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.185102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.186584] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 962.217652] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.217812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.217888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.218117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.218262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.222281] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.222536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.222632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.222861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.223080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.241057] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 962.241821] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: IN_PROGRESS for 2s [ 962.401773] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d4cd27cd-e5e9-4cef-901e-bc72b686a070 None None] Enqueued Resource ID: f835517c-d924-488a-af80-e6f823f03a9c with Priority: HIGHEST for action port [ 962.402737] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f835517c-d924-488a-af80-e6f823f03a9c with Priority: HIGHEST for action port [ 962.402864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f835517c-d924-488a-af80-e6f823f03a9c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.402984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f835517c-d924-488a-af80-e6f823f03a9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.403057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f835517c-d924-488a-af80-e6f823f03a9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.403354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f835517c-d924-488a-af80-e6f823f03a9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.403446] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f835517c-d924-488a-af80-e6f823f03a9c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.574818] env[65319]: INFO networking_nsxv3.common.synchronization [req-baedef6c-cabb-422e-8d65-ac0dad3f1e42 req-9a2b275b-f698-48ce-b633-904bb48201c5 tempest-ImagesTestJSON-144723306 tempest-ImagesTestJSON-144723306-project-member] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 962.576444] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGHEST for action security_group_members [ 962.576735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.580027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.580027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.580027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.665295] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.676051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.676051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.676051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.676051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.676291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.676291] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.676663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.676663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.676663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.676663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.676845] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be updated. [ 962.686663] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 962.686958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.689498] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.692175] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.692175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.692175] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.692175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.692175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.692175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.692175] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.692175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.692175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.709524] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.709524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.709524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.709524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.709524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.716895] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.717108] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.717252] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.717431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.717741] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-46a32361-2d08-48e4-bc6f-781b6a3a53f3 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.717911] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.718033] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.718347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.718485] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a32361-2d08-48e4-bc6f-781b6a3a53f3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.721390] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: IN_PROGRESS for 2s [ 962.895579] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 962.896678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.896678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.899020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.899020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.899020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.899020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.899020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.899020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.899020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.900929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 in Status: SUCCESS [ 962.901288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.901777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.902088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.902356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.902581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.902718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.902997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.904019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.904019] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.905185] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f835517c-d924-488a-af80-e6f823f03a9c [ 962.905581] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.906155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.906341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.906629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.907058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.907058] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f835517c-d924-488a-af80-e6f823f03a9c already deleted. [ 962.907058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f835517c-d924-488a-af80-e6f823f03a9c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.080350] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.080545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.080590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.081356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.081356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.081356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.081356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.081356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.081866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.081959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.082068] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be updated. [ 963.112978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.113205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.113250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.113450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.113604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.122808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: IN_PROGRESS for 2s [ 963.167781] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.221820] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.221948] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.222076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.222535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.222535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.222687] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 46a32361-2d08-48e4-bc6f-781b6a3a53f3 not found, creating... [ 963.222986] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.223204] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.223304] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.223527] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.223667] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.223955] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.224171] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.224351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.224608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.224798] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.224996] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 46a32361-2d08-48e4-bc6f-781b6a3a53f3 is going to be created. [ 963.247227] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.247227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.247227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.248076] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.248458] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.248792] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.315633] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 963.315633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.316162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.316387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.316477] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.402511] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.406704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.406794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.406861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.407078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.407176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.407454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.407561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.407561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.407780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.407780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.407890] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 is going to be deleted. [ 963.460760] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.460760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.460760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.460760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.460760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.460760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.461248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.461248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.461248] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.461376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.461445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.461545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.461662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.461709] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.671354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.671354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.671514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.671720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.671809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.671957] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 963.708126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.708530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.708530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.708530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.708652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.718256] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 963.822684] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.822684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.907414] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.961305] env[65319]: INFO networking_nsxv3.common.synchronization [req-6dfa3b72-75e5-442e-88ef-92e33a6d6a9d req-b8ac33a1-d73a-46a5-93db-4966721d34d3 service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 963.961617] env[65319]: INFO networking_nsxv3.common.synchronization [req-6dfa3b72-75e5-442e-88ef-92e33a6d6a9d req-b8ac33a1-d73a-46a5-93db-4966721d34d3 service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 963.961824] env[65319]: INFO networking_nsxv3.common.synchronization [req-6dfa3b72-75e5-442e-88ef-92e33a6d6a9d req-b8ac33a1-d73a-46a5-93db-4966721d34d3 service nova] Enqueued Resource ID: 46a32361-2d08-48e4-bc6f-781b6a3a53f3 with Priority: HIGHEST for action port [ 963.962785] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 963.963143] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 963.963143] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a32361-2d08-48e4-bc6f-781b6a3a53f3 with Priority: HIGHEST for action port [ 963.963398] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.963620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.963688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.963896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.963989] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.965972] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.966094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.966330] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a32361-2d08-48e4-bc6f-781b6a3a53f3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.966492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.966559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.966743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.966821] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a32361-2d08-48e4-bc6f-781b6a3a53f3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.967873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.967873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.967976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.968084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.968162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.968705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.969434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.969434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.969434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.969434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.969434] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 already deleted. [ 963.969434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.969434] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.971487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.971672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.972757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.972757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.972757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.972757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.972757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.972757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.251843] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 964.252166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.252392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.252660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.253078] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.253078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.253078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.253561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.253561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.253561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.253561] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.255551] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 in Status: SUCCESS [ 964.256314] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 deletion is rescheduled due to dependency. [ 964.256646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.411153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.411407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.411586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.411951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.412255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.412761] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 964.449479] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.449710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.449822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.450138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.450341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.466470] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 964.467150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.467150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.471155] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f216114-266a-41e4-8c9e-40f72b06dd73',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.472805] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46a32361-2d08-48e4-bc6f-781b6a3a53f3 with status ACTIVE [ 964.473162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.473162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.473322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.473466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.473556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.473749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.473855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.473919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.474097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.474177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.474367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.474465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.474543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.474801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.474866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.474904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46a32361-2d08-48e4-bc6f-781b6a3a53f3 is going to be updated. [ 964.477363] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.477363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.477363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.477363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.477363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.477601] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.477601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.477702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.478607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.478607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.478607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 already deleted. [ 964.478607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.508439] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.508632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.508678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.508886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.509039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.509196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a32361-2d08-48e4-bc6f-781b6a3a53f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.734054] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe in Status: SUCCESS [ 964.734281] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe deletion is rescheduled due to dependency. [ 964.734387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.760329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.760329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.760329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.760329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.760329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.762272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.762272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.762272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.762272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.762272] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.980477] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f216114-266a-41e4-8c9e-40f72b06dd73: rpc.has_security_group_logging(os_id): False [ 964.996777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.997167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.997167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.997405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.997405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.997653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.997759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.997827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.998018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.998103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.998209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 is going to be created. [ 965.024289] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73], does not exist path=[/infra/domains/default/groups/0f216114-266a-41e4-8c9e-40f72b06dd73]."\n}' [ 965.024289] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73 [ 965.024289] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 965.063519] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.063958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.064198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.064525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.066116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.066641] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.066929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.068629] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.068629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.068629] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f216114-266a-41e4-8c9e-40f72b06dd73 is going to be created. [ 965.089286] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73], does not exist path=[/infra/domains/default/groups/0f216114-266a-41e4-8c9e-40f72b06dd73]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73 [ 965.089286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f216114-266a-41e4-8c9e-40f72b06dd73" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.089521] env[65319]: Traceback (most recent call last): [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 965.089630] env[65319]: return func(*args, **kwargs) [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 965.089630] env[65319]: res.raise_for_status() [ 965.089630] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 965.089630] env[65319]: raise HTTPError(http_error_msg, response=self) [ 965.089630] env[65319]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73 [ 965.089630] env[65319]: During handling of the above exception, another exception occurred: [ 965.089630] env[65319]: Traceback (most recent call last): [ 965.089630] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 965.089630] env[65319]: listener.cb(fileno) [ 965.089630] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 965.089630] env[65319]: result = function(*args, **kwargs) [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 965.089630] env[65319]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 965.089630] env[65319]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 965.089630] env[65319]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 965.089630] env[65319]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 965.089630] env[65319]: res.raise_for_status() [ 965.089630] env[65319]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 965.089630] env[65319]: raise HTTPError(http_error_msg, response=self) [ 965.089630] env[65319]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0f216114-266a-41e4-8c9e-40f72b06dd73 [ 965.089630] env[65319]: Removing descriptor: 13 [ 965.133820] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b in Status: SUCCESS [ 965.133820] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b deletion is rescheduled due to dependency. [ 965.134262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.263921] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f47eb94-bdf5-494d-a378-78951389d1ea: rpc.has_security_group_logging(os_id): False [ 965.285465] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.285684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.285684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.285957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.310730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.311186] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.311413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.311917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.312592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.312975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.313302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.313500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.313690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.314286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.314438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.314693] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.314982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.314982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.315080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.315292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.315397] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 965.395119] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.395414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.395527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.395754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.395921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.413484] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 965.729387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 4s [ 966.477250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 966.477614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.477681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.477888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.478072] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.478191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.478254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.478437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.478511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.478591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.478673] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.479507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.479682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.479873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.479982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.480096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.480248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.480326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.481031] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.985307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.985307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.985599] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.428924] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 967.429290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.429355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.429589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.430412] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.492499] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.742075] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 967.742196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.742322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.743976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.743976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.743976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.743976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.743976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.743976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.743976] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.934022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.934194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.934265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.934473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.934635] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.934734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.934797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.934963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.935040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.935126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.935211] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.995898] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.995898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.995898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.997540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.997540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.997540] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 968.032287] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.032456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.032510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.032723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.032869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.047769] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 968.150299] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7132f1c-5377-4f84-9430-ab7ab0a22c6a req-e62302b6-d307-4af5-8cff-b87e6d905473 tempest-ServerTagsTestJSON-578749941 tempest-ServerTagsTestJSON-578749941-project-member] Enqueued Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 968.151818] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 968.155060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.155060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.155060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.155060] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.249934] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.440685] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.440915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.441019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.441346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.441594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.441817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.441817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.442056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.442227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.442383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.442634] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.442775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.442880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.443140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.443373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.443534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.443831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.443901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.443994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.444153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.444350] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.593705] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-662 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.594035] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-662" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.594168] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-662" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.594610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-662" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.594979] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.595371] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.595557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.595855] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.596084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.596375] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.596540] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.596705] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.596863] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.597041] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.597204] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.597398] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.620354] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.620354] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.620354] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.620581] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-662" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.621261] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-b7214879-e1b2-40a9-aad9-805fe0161650 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.621394] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.621516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.622101] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.622101] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7214879-e1b2-40a9-aad9-805fe0161650',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.655755] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.657045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.657045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.657688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.657688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.657688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 already deleted. [ 968.657688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.752255] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.947345] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f47eb94-bdf5-494d-a378-78951389d1ea: rpc.has_security_group_logging(os_id): False [ 968.964565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.964734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.964782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.964997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.965108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.965367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.965456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.965523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.965675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.965751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.965928] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.966033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.966097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.966235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.966306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.966496] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.966588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.966649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.966784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.966857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.966965] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 969.029597] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.029597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.029597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.029597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.042923] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 969.124426] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.124711] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.124844] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.125150] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.125397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.125577] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port b7214879-e1b2-40a9-aad9-805fe0161650 not found, creating... [ 969.125886] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.126074] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.126198] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.126472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.126615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.126938] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.127114] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.127235] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.127496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.127704] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.127836] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: b7214879-e1b2-40a9-aad9-805fe0161650 is going to be created. [ 969.150022] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.151506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.151506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.151506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.151506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.151506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.254462] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.254676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.254676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.255951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.255951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.255951] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 969.292187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.292792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.292792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.292792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.292943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.303848] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 969.850623] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7132f1c-5377-4f84-9430-ab7ab0a22c6a req-4d50c6a7-7491-47bd-ab22-cd7b607c0567 service nova] Enqueued Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_rules [ 969.850880] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7132f1c-5377-4f84-9430-ab7ab0a22c6a req-4d50c6a7-7491-47bd-ab22-cd7b607c0567 service nova] Enqueued Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 969.850880] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7132f1c-5377-4f84-9430-ab7ab0a22c6a req-4d50c6a7-7491-47bd-ab22-cd7b607c0567 service nova] Enqueued Resource ID: b7214879-e1b2-40a9-aad9-805fe0161650 with Priority: HIGHEST for action port [ 969.851548] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_rules [ 969.851794] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 969.851794] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7214879-e1b2-40a9-aad9-805fe0161650 with Priority: HIGHEST for action port [ 969.852096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.852216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.852293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.852547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.852632] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.853590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.853707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.853775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.854022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.856476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.856682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.856800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.857042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.858490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.858669] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.859971] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7214879-e1b2-40a9-aad9-805fe0161650 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.860158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.860948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.861192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.861328] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7214879-e1b2-40a9-aad9-805fe0161650',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.062314] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.062314] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.062314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.062314] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.165024] env[65319]: INFO networking_nsxv3.common.synchronization [req-d4ef7f40-ca8c-474b-846e-af93630424f4 req-0159dffb-e92b-47ce-bd57-f914836bd082 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 970.165024] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 970.165588] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.165856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.166032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.166483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.166751] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.166959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.168370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.168370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.168370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.168370] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.365220] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.365220] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.365220] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7214879-e1b2-40a9-aad9-805fe0161650 with status ACTIVE [ 970.365220] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.365220] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.365220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.366195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.366195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.367884] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.367884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.367884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.367884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.367884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.367884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7214879-e1b2-40a9-aad9-805fe0161650 is going to be updated. [ 970.392268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.392268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.392268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.392268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.392268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.392268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7214879-e1b2-40a9-aad9-805fe0161650" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.457022] env[65319]: INFO networking_nsxv3.common.synchronization [None req-88d4c77e-45c1-4366-825d-6cc742642c01 None None] Enqueued Resource ID: 95a7959c-6f36-40ab-bf93-ba5b79aa9ce2 with Priority: HIGHEST for action port [ 970.457022] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95a7959c-6f36-40ab-bf93-ba5b79aa9ce2 with Priority: HIGHEST for action port [ 970.457022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-95a7959c-6f36-40ab-bf93-ba5b79aa9ce2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.457022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95a7959c-6f36-40ab-bf93-ba5b79aa9ce2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.457022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95a7959c-6f36-40ab-bf93-ba5b79aa9ce2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.457022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95a7959c-6f36-40ab-bf93-ba5b79aa9ce2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.457022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95a7959c-6f36-40ab-bf93-ba5b79aa9ce2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.564445] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.671911] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.672206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.672298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.672596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.696756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.697140] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.697297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.697416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.697731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.697894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.697947] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 970.731246] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.731479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.731479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.731660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.731802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.741491] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 970.865621] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.960671] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95a7959c-6f36-40ab-bf93-ba5b79aa9ce2 [ 970.960803] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.960900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.960900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.964591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.964591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.964591] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95a7959c-6f36-40ab-bf93-ba5b79aa9ce2 already deleted. [ 970.964591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95a7959c-6f36-40ab-bf93-ba5b79aa9ce2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.059539] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 971.059539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.074203] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.316940] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 971.317142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.318101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.318101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.318101] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.318101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.318101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.318382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.318382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.318464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.318613] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.369618] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.369796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.369888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.370170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.370275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.370377] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 is going to be created. [ 971.397547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.397760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.397840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.398070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.401326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.412672] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: UNINITIALIZED for 2s [ 971.576279] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.576279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.576279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.576279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.576279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.576279] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 971.606714] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.606856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.606928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.607158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.607297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.617583] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 971.824474] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.828027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.828027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.828027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.828027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.828804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.828804] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.145627] env[65319]: INFO networking_nsxv3.common.synchronization [req-d404b804-500b-44b1-b926-cfb53ab060a0 req-a0be3b79-2163-48f1-b1cb-45b914492604 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 972.147086] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 972.147778] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.147778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.147778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.148083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.148083] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.149027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.149027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.149027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.149027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.149027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.332119] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57b692c1-c9a8-4318-94f5-2184ff1f58ef: rpc.has_security_group_logging(os_id): False [ 972.351390] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.351665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.351665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.352327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.379246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.379660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.380047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.380047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.381052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.381130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.381495] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.381650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.381760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.381996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.382166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.382480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.382625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.382721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.382908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.383111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.383167] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 972.462530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.463072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.463188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.463445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.463747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.481142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 972.650861] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.651040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.651098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.651311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.676783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.677129] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.677289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.677362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.677862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.678010] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.678233] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 972.721407] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.721407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.721407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.721407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.721407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.733498] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 972.754745] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 972.754745] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 972.754745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.098718] env[65319]: INFO networking_nsxv3.common.synchronization [None req-87626a80-666c-4446-b319-91ecfade1fdf None None] Enqueued Resource ID: d0b10d23-7df2-4d8f-a189-655499343930 with Priority: HIGHEST for action port [ 973.099462] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b10d23-7df2-4d8f-a189-655499343930 with Priority: HIGHEST for action port [ 973.103361] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b10d23-7df2-4d8f-a189-655499343930 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.104812] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b10d23-7df2-4d8f-a189-655499343930" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.104894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b10d23-7df2-4d8f-a189-655499343930" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.105197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b10d23-7df2-4d8f-a189-655499343930" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.105412] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b10d23-7df2-4d8f-a189-655499343930',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.423095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: SUCCESS [ 973.423468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.423532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.424086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.424086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.424467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.424467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.424467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.424467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.424467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.424774] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.609425] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b10d23-7df2-4d8f-a189-655499343930 [ 973.610152] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.610152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.610152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.610372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.610372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.610448] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b10d23-7df2-4d8f-a189-655499343930 already deleted. [ 973.610483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b10d23-7df2-4d8f-a189-655499343930" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.629088] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 973.629307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.629590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.629723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.629937] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.630312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.630312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.630312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.630465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.630465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.630610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.630699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.630757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.630896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.631051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.631198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.631293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.631473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.631552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.631635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.631740] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.808272] env[65319]: INFO networking_nsxv3.common.synchronization [req-b99e096b-75b4-40f5-a69e-e0020e10b791 req-4e49813c-30de-4d35-8082-7c5d4ea370c1 tempest-ServerRescueTestJSONUnderV235-393248413 tempest-ServerRescueTestJSONUnderV235-393248413-project-member] Enqueued Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 973.808863] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 with Priority: HIGHEST for action security_group_members [ 973.809204] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.809334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.809403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.809613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.809771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.809871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.809937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.810104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.810191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.810285] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.927041] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.927324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.927324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.927441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.927731] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.927849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.927849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.928215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.928352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.928718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.928718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.928995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.928995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.929117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.929222] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.929309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.929478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.929587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.929629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.929722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.929785] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.135403] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9: rpc.has_security_group_logging(os_id): False [ 974.156445] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.156673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.156673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.156884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.179136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.179472] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.179627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.179711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.179969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.180049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.180218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.180322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.180386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.180530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.180607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.180788] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.180881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.180943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.181099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.181175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.181259] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 974.271375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.271375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.271375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.271583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.271687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.292990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 974.312976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.316019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.316019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.316019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be updated. [ 974.378619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.378807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.378868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.379114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.379340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.390740] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: IN_PROGRESS for 2s [ 974.433150] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7309368a-6428-4484-9891-a482e0bc1bd4: rpc.has_security_group_logging(os_id): False [ 974.455017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.455255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.455791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.456071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.456227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.456547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.456725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.456804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.457049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.457337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.457727] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.457895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.458031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.458252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.458436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.458756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.458935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.459252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.459387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.459527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.459689] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 is going to be created. [ 974.498882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 974.499295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.557172] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.557416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.557416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.557705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.557933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.575170] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: IN_PROGRESS for 2s [ 974.605458] env[65319]: INFO networking_nsxv3.common.synchronization [req-67fe2f0e-b888-4354-bd81-501e41b9b5df req-fe80aa98-dc7e-40f2-b0a8-a6bea5687425 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 974.606265] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 974.606808] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.610811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.610905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.611190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.611544] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.611708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.611835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.613286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.613286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.613286] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.744634] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 974.744858] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f deletion is rescheduled due to dependency. [ 974.744978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.831850] env[65319]: INFO networking_nsxv3.common.synchronization [req-67fe2f0e-b888-4354-bd81-501e41b9b5df req-3050e83f-0cee-4bb0-98bb-7a71d18a85dc tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 974.832550] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 974.832897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.832995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.116207] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.137768] env[65319]: INFO networking_nsxv3.common.synchronization [req-67fe2f0e-b888-4354-bd81-501e41b9b5df req-4222542a-393d-47dc-ac98-a252cc4cd415 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 975.138444] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 975.139017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.139232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.617020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.667702] env[65319]: INFO networking_nsxv3.common.synchronization [req-63b078d4-6ab6-4c7c-aeb5-2e92bc3e5897 req-d1078b96-25ad-4418-9bf0-a61fe0a5f2dd tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 975.668287] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGHEST for action security_group_members [ 975.668600] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.668942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.668942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.669075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.669140] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.669230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.669291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.669435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.669518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.669607] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.120208] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.120208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.120208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.120813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.120813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.120813] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 976.152195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.152314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.152433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.152951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.153377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.165093] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 976.172097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.174241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.174241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.174241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.196478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.196478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.196478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.196478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.196478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.196478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.196478] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f is going to be updated. [ 976.233921] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.234186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.234186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.234396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.234931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.247330] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: IN_PROGRESS for 2s [ 976.256720] env[65319]: INFO networking_nsxv3.common.synchronization [req-0eef701f-c4da-41c4-95db-9139a96f8f53 req-fa41dfbd-1f7c-45e8-a7cb-c3ce9ad22c3e tempest-ServersNegativeTestJSON-1277425665 tempest-ServersNegativeTestJSON-1277425665-project-member] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 976.257282] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 976.257600] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.257728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.257796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.258015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.258370] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.258482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.258621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.259032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.259128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.259227] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.312703] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 976.313061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.313507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.315228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.315228] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e39bde-5bd7-4791-90b9-b6eb4d7c40d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.407899] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 in Status: SUCCESS [ 976.408305] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 deletion is rescheduled due to dependency. [ 976.408305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.447079] env[65319]: INFO networking_nsxv3.common.synchronization [req-aac39dda-36e2-4839-8073-19e5422d7d85 req-2576d8a2-7459-4891-beb8-ada812099787 tempest-ServerMetadataTestJSON-1590710980 tempest-ServerMetadataTestJSON-1590710980-project-member] Enqueued Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 976.447859] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGHEST for action security_group_members [ 976.448068] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.449091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.449091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.449091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.449269] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.449374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.449434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.449742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.449865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.450075] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.589590] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: SUCCESS [ 976.589829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.762429] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.836019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.836233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.836280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.836586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.836688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.836794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e39bde-5bd7-4791-90b9-b6eb4d7c40d9 is going to be deleted. [ 976.909248] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.909435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.909511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.909721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.910353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.910353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e39bde-5bd7-4791-90b9-b6eb4d7c40d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.953138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.953443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.953532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.953755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.996712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.997421] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.997421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.997421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.997421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.998165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.998165] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 is going to be updated. [ 977.039235] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.039410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.039452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.039747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.040179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.048990] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: IN_PROGRESS for 2s [ 977.264483] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.767667] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.768072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.768072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.768186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.768281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.768394] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 977.801291] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.801474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.801519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.801839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.802040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.829526] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 978.177503] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 978.178017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.178109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.178388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.178922] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.178922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.178922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.179209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.179209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.179209] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.263214] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f in Status: SUCCESS [ 978.263214] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f deletion is rescheduled due to dependency. [ 978.263214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.684735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.684735] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.684735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.684735] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 978.720612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.721065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.721065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.721065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.721299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.732603] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 979.058870] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 in Status: SUCCESS [ 979.059195] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 deletion is rescheduled due to dependency. [ 979.059314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.775130] env[65319]: INFO networking_nsxv3.common.synchronization [req-3699df34-1364-4b5a-9909-99063a3d6c99 req-d57abe73-e87a-4390-8768-619d782b69b0 tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 979.775749] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGHEST for action security_group_members [ 979.777422] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.777422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.777422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.777422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.777422] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.777422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.777725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.777725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.777725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.777814] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.841592] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 979.841853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.283566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.283857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.283857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.284036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.313178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.313178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.313178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.313178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.313178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.313178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.313178] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 is going to be updated. [ 980.343015] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.345329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.345329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.345329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.345329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.354095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: IN_PROGRESS for 2s [ 980.645698] env[65319]: INFO networking_nsxv3.common.synchronization [req-10d9ff23-daf5-4236-af8c-b373a0e96f35 req-f9a80a89-bb18-46dd-aa3d-35c9472c9c13 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 980.649164] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 980.649840] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.649840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.649840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.650017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.650125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.650226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.650288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.650478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.650520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.650624] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.746245] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 980.746245] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea deletion is rescheduled due to dependency. [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.746245] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.746245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.746245] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.070175] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.070175] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.070175] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.070175] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.070175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.070175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.070175] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.070825] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.070825] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.070825] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.094035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.094320] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.094488] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.094701] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.095665] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-92c75d56-545d-47a8-b025-9eff23e54d26 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.095665] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.095665] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.096018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.096018] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c75d56-545d-47a8-b025-9eff23e54d26',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.153272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.153385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.153437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.154823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.154823] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 already deleted. [ 981.154823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.250780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.250780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.250780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.251032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.252021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.252021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.252021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.252021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.252021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.252021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.252021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 981.286508] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.286508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.286508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.286920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.286920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.296720] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 981.598431] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.598626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.598718] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.599022] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.599180] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.599339] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 92c75d56-545d-47a8-b025-9eff23e54d26 not found, creating... [ 981.599634] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.599796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.599870] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.600112] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.600252] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.600533] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.600689] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.600803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.601012] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.601156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.601293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 92c75d56-545d-47a8-b025-9eff23e54d26 is going to be created. [ 981.623407] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.623648] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.623774] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.624150] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.624388] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.624615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.329090] env[65319]: INFO networking_nsxv3.common.synchronization [req-10d9ff23-daf5-4236-af8c-b373a0e96f35 req-0b9dc33d-a614-41af-86e5-98456fbdc3d6 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 982.330062] env[65319]: INFO networking_nsxv3.common.synchronization [req-10d9ff23-daf5-4236-af8c-b373a0e96f35 req-0b9dc33d-a614-41af-86e5-98456fbdc3d6 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 982.330062] env[65319]: INFO networking_nsxv3.common.synchronization [req-10d9ff23-daf5-4236-af8c-b373a0e96f35 req-0b9dc33d-a614-41af-86e5-98456fbdc3d6 service nova] Enqueued Resource ID: 92c75d56-545d-47a8-b025-9eff23e54d26 with Priority: HIGHEST for action port [ 982.333425] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 982.333597] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 982.333725] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c75d56-545d-47a8-b025-9eff23e54d26 with Priority: HIGHEST for action port [ 982.334073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.334203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.334284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.334593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.334685] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.335675] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.335799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.335881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.336705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.336908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.337041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.337114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.337419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.337512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.337641] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.339096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c75d56-545d-47a8-b025-9eff23e54d26 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.339253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.339337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.339984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.339984] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c75d56-545d-47a8-b025-9eff23e54d26',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.364870] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 in Status: SUCCESS [ 982.364870] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 deletion is rescheduled due to dependency. [ 982.364870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.841876] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92c75d56-545d-47a8-b025-9eff23e54d26 with status ACTIVE [ 982.842053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.842190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.842258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.842477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.842565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.842906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.845016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.845016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.845016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92c75d56-545d-47a8-b025-9eff23e54d26 is going to be updated. [ 982.845472] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.846028] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.846129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.873274] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.873503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.873503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.873791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.873899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.873998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c75d56-545d-47a8-b025-9eff23e54d26" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.970018] env[65319]: INFO networking_nsxv3.common.synchronization [None req-452baba0-d0b3-4d3e-a4c5-5a937c774128 None None] Enqueued Resource ID: 73c64218-0b94-40ec-9e80-0278d73ca6b5 with Priority: HIGHEST for action port [ 982.970018] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c64218-0b94-40ec-9e80-0278d73ca6b5 with Priority: HIGHEST for action port [ 982.970018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c64218-0b94-40ec-9e80-0278d73ca6b5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.970018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c64218-0b94-40ec-9e80-0278d73ca6b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.970412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c64218-0b94-40ec-9e80-0278d73ca6b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.970764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c64218-0b94-40ec-9e80-0278d73ca6b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.970953] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c64218-0b94-40ec-9e80-0278d73ca6b5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.298417] env[65319]: INFO networking_nsxv3.common.synchronization [req-745b444e-2921-4e1d-ab35-d6349ec0f2f6 req-9921db44-b5a7-4ac8-a6e9-472c323a3e02 tempest-TenantUsagesTestJSON-2110921962 tempest-TenantUsagesTestJSON-2110921962-project-member] Enqueued Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 983.300585] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 983.301059] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.301564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.301683] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.301969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.302514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.302679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.302789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.302993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.303131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.303254] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.314216] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 983.314216] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea deletion is rescheduled due to dependency. [ 983.314216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.352618] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.473555] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73c64218-0b94-40ec-9e80-0278d73ca6b5 [ 983.473867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.473960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.474067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.474557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.474557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.474557] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73c64218-0b94-40ec-9e80-0278d73ca6b5 already deleted. [ 983.474557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c64218-0b94-40ec-9e80-0278d73ca6b5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.612282] env[65319]: INFO networking_nsxv3.common.synchronization [req-2c7f09b9-b541-4552-97c9-b8862689ca04 req-2d220558-9957-4ba4-8e4e-4fa7edcbe211 tempest-ServerTagsTestJSON-578749941 tempest-ServerTagsTestJSON-578749941-project-member] Enqueued Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 983.612654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGHEST for action security_group_members [ 983.612985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.613119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.613192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.613402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.613579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.613731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.613731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.613896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.613988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.614093] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.676533] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.676533] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.676751] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.676950] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.677208] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.677406] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.677551] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.677858] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.678016] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.678265] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.678404] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.678538] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.678668] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.678797] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.678925] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.679152] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.698474] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.698645] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 983.698781] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.698958] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-151" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.699293] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-fb5656f1-7e62-4710-b71d-3d11440d2e3c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.699470] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.699591] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.699897] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.700053] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5656f1-7e62-4710-b71d-3d11440d2e3c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.806157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.806157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.806157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.806157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.806157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.806428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.806428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.806561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.806596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.806681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.806749] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 already deleted. [ 983.806821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.859936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.860199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.861350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.861794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.861794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.861794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be created. [ 983.908097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.908272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.908323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.908729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.908729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.918107] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: UNINITIALIZED for 2s [ 984.116190] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.116355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.116435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.116673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.116767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.116973] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.117090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.117166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.117378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.117418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.117512] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 is going to be updated. [ 984.135169] env[65319]: INFO networking_nsxv3.common.synchronization [None req-a702c61f-c66e-448e-bb99-8d598b6c3b19 tempest-ServersTestBootFromVolume-1104516695 tempest-ServersTestBootFromVolume-1104516695-project-member] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 984.135760] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 984.136082] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.136201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.136265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.136677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.136775] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.146983] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.147147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.147716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.147716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.147716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.157241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: IN_PROGRESS for 2s [ 984.206237] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.206509] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.206642] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.206910] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.207070] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.207219] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port fb5656f1-7e62-4710-b71d-3d11440d2e3c not found, creating... [ 984.207489] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.207636] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.207779] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.207987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.208290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.208401] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.208737] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.208871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.209129] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.209377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.209810] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: fb5656f1-7e62-4710-b71d-3d11440d2e3c is going to be created. [ 984.230326] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.230703] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.230703] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.230995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.231246] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.231679] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.281222] env[65319]: INFO networking_nsxv3.common.synchronization [None req-424858c2-30c7-485f-b397-538b131573a5 tempest-ServersTestBootFromVolume-1104516695 tempest-ServersTestBootFromVolume-1104516695-project-member] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 984.281854] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 984.282425] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.282552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.658655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.658655] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 already deleted. [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.658655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.658655] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [req-745b444e-2921-4e1d-ab35-d6349ec0f2f6 req-782756de-9bcf-439b-8987-86dc2a7a7be0 service nova] Enqueued Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_rules [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [req-745b444e-2921-4e1d-ab35-d6349ec0f2f6 req-782756de-9bcf-439b-8987-86dc2a7a7be0 service nova] Enqueued Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [req-745b444e-2921-4e1d-ab35-d6349ec0f2f6 req-782756de-9bcf-439b-8987-86dc2a7a7be0 service nova] Enqueued Resource ID: fb5656f1-7e62-4710-b71d-3d11440d2e3c with Priority: HIGHEST for action port [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_rules [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 984.987500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5656f1-7e62-4710-b71d-3d11440d2e3c with Priority: HIGHEST for action port [ 984.990148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.990148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.990148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.990148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.990148] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.991674] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.991674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.991840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.992266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.992266] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.993027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.993027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.993027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.993027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.993027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.993990] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5656f1-7e62-4710-b71d-3d11440d2e3c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.994094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.994153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.994362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.994514] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5656f1-7e62-4710-b71d-3d11440d2e3c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.181465] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.181465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.181671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.181847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.181945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.182065] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 already deleted. [ 985.182182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.496632] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.503192] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.503192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.503192] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb5656f1-7e62-4710-b71d-3d11440d2e3c with status ACTIVE [ 985.503390] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.503390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.503505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.504524] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.504524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.504817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.504817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.504817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.504995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.505094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.505530] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb5656f1-7e62-4710-b71d-3d11440d2e3c is going to be updated. [ 985.528440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.528440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.528440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.528666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.529316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.529316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5656f1-7e62-4710-b71d-3d11440d2e3c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.901630] env[65319]: INFO networking_nsxv3.common.synchronization [None req-06d285f7-a2d1-43d5-b700-744185b79b68 None None] Enqueued Resource ID: c65055b5-6675-4c61-b058-f6a97a16d1e1 with Priority: HIGHEST for action port [ 985.902169] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65055b5-6675-4c61-b058-f6a97a16d1e1 with Priority: HIGHEST for action port [ 985.902472] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c65055b5-6675-4c61-b058-f6a97a16d1e1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.902596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c65055b5-6675-4c61-b058-f6a97a16d1e1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.902649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c65055b5-6675-4c61-b058-f6a97a16d1e1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.902886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c65055b5-6675-4c61-b058-f6a97a16d1e1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.903736] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c65055b5-6675-4c61-b058-f6a97a16d1e1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.928146] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 985.928287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.928438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.928774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.928831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.928941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.929134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.929192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.929524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.929524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.929524] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.007626] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.171251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7309368a-6428-4484-9891-a482e0bc1bd4 in Status: SUCCESS [ 986.171251] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 deletion is rescheduled due to dependency. [ 986.171251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.407250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c65055b5-6675-4c61-b058-f6a97a16d1e1 [ 986.407564] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.407763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.407763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.408419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.408419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.408419] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c65055b5-6675-4c61-b058-f6a97a16d1e1 already deleted. [ 986.408419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c65055b5-6675-4c61-b058-f6a97a16d1e1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.431499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.431673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.431766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.431974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.432163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.432266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.432331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.432499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.432582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.432668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.432817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.432936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.432970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.433116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.433262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.433383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.433446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.433590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.433667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.433748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.433834] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.510652] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.510652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.510652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.510862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.510936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.511034] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 is going to be created. [ 986.535576] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.535745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.535799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.536013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.536178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.546023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: UNINITIALIZED for 2s [ 986.936528] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 986.957274] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.957441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.957502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.957739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.957797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.958013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.958125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.958188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.958334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.958413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.958601] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.958710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.958748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.958881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.958953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.959375] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.959375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.959375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.959485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.959560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.959625] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be created. [ 987.045757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.046034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.046105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.046338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.046565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.060320] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 987.677117] env[65319]: INFO networking_nsxv3.common.synchronization [req-9083b819-30ea-4084-a8d4-4d64d92932ad req-f03b0fa2-5f6c-4d93-89b4-34f346f54da0 tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 987.677760] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGHEST for action security_group_members [ 987.678130] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.678354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.678435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.678761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.678923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.679037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.679151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.679333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.679461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.679580] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.182096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.182498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.182498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.182690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.208197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.208197] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.208197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.208197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.208197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.208197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.208197] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be updated. [ 988.236024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.236113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.236207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.236449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.236612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.247643] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: IN_PROGRESS for 2s [ 988.559053] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: SUCCESS [ 988.559053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.559285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.559517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.559839] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.559981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.560100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.560410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.561029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.561029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.561029] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.063134] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.064630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.064630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.065188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.065188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.065188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.065188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.065314] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.066179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.066179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.066179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.066179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.066179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.066179] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.075326] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 989.075601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.570404] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d656de1a-0150-4fda-a0db-f5e7f52ff373: rpc.has_security_group_logging(os_id): False [ 989.594651] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.594808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.595417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.595417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.595417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.595681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.595681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.595681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.595837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.595873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.596178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.596178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.596299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.596386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.596673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.596673] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.596835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.596835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.596938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.597021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.597131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 is going to be created. [ 989.671580] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.671724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.671724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.672371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.672371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.683823] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: IN_PROGRESS for 2s [ 989.761463] env[65319]: INFO networking_nsxv3.common.synchronization [req-07804d5f-3ae4-4ac4-a765-1f0cf80754c6 req-1ffa5f09-5cf2-4aef-b86d-fbcaa5cee2a4 tempest-ServerGroupTestJSON-820323969 tempest-ServerGroupTestJSON-820323969-project-member] Enqueued Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 989.762095] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 989.762717] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.763120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.763275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.763659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.763873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.764168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.764327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.764482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.764601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.764730] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.212870] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.213067] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-548" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.213232] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-548" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.213715] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-548" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.214291] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.214291] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.214291] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.214598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.214704] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.214988] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.215114] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.215215] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.215339] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.215585] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.215622] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.215744] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.236872] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.237075] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.237217] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.237396] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-548" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.237719] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-2663dae7-9f04-4c26-9bc2-be7500023e8e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.237881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.238009] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.238383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.238449] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2663dae7-9f04-4c26-9bc2-be7500023e8e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.258647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 in Status: SUCCESS [ 990.258921] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 deletion is rescheduled due to dependency. [ 990.259135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.266845] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.267054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.267112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.267373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.267544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.268029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.268029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.268029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.268226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.268282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.268412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 already deleted. [ 990.268527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.741082] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.741429] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.743215] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 2663dae7-9f04-4c26-9bc2-be7500023e8e not found, creating... [ 990.743215] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.743215] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.743590] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.743953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.744128] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.744431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.744662] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.744818] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 2663dae7-9f04-4c26-9bc2-be7500023e8e is going to be created. [ 990.768104] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.768314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.768435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.768693] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.768915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.769400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.792409] env[65319]: INFO networking_nsxv3.common.synchronization [None req-58995e22-9564-4a84-b57e-202bdcfb76a5 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 990.792409] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 990.792409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.792409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.792409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.792995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.793299] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.973292] env[65319]: INFO networking_nsxv3.common.synchronization [None req-fff2ec30-11fa-4b9b-b55c-055809b16d11 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 990.973292] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 990.973567] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.973855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.316148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.316342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.316449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.316797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.316951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.317133] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 already deleted. [ 991.317280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.317481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.317686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.317801] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.496938] env[65319]: INFO networking_nsxv3.common.synchronization [req-07804d5f-3ae4-4ac4-a765-1f0cf80754c6 req-b7c39818-b235-4251-aa4e-ca38fe3af360 service nova] Enqueued Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_rules [ 991.497132] env[65319]: INFO networking_nsxv3.common.synchronization [req-07804d5f-3ae4-4ac4-a765-1f0cf80754c6 req-b7c39818-b235-4251-aa4e-ca38fe3af360 service nova] Enqueued Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 991.497272] env[65319]: INFO networking_nsxv3.common.synchronization [req-07804d5f-3ae4-4ac4-a765-1f0cf80754c6 req-b7c39818-b235-4251-aa4e-ca38fe3af360 service nova] Enqueued Resource ID: 2663dae7-9f04-4c26-9bc2-be7500023e8e with Priority: HIGHEST for action port [ 991.497801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_rules [ 991.497937] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 991.498177] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2663dae7-9f04-4c26-9bc2-be7500023e8e with Priority: HIGHEST for action port [ 991.500214] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.500214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.500214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.501202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.501202] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.501827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.501827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.501827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.501990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.502121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.502212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.502270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.502412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.502491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.502576] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.504655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2663dae7-9f04-4c26-9bc2-be7500023e8e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.504655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.504655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.504655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.504655] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2663dae7-9f04-4c26-9bc2-be7500023e8e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.699060] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: SUCCESS [ 991.699060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.841653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.841653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.841653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.841653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.841653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.841653] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 already deleted. [ 991.841653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.005767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.006025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.006248] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.007900] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2663dae7-9f04-4c26-9bc2-be7500023e8e with status ACTIVE [ 992.008155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.008309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.008309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.008538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.008624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.008808] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.008906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.009243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.009243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.009438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.009480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.009572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.009629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.009807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.009850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.009916] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2663dae7-9f04-4c26-9bc2-be7500023e8e is going to be updated. [ 992.033099] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.033372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.033372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.033523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.033668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.033834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2663dae7-9f04-4c26-9bc2-be7500023e8e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.513701] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.017048] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.017880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.019407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.019407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.019407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.019407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 is going to be created. [ 993.056619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.056825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.056869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.057155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.057392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.070147] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: UNINITIALIZED for 2s [ 993.142149] env[65319]: INFO networking_nsxv3.common.synchronization [req-174c861f-0a66-4aba-965c-74f359ec7f08 req-ebae12ad-ab30-4e88-84c9-282885eef400 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 993.142149] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGHEST for action security_group_members [ 993.142149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.142149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.142149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.142149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.142149] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.142149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.142149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.143226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.143325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.143427] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.645953] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.646331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.646331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.646429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.672653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.672653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.672653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.672653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.672653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.672653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.672653] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a6c793-0760-435d-be82-33d755948f79 is going to be updated. [ 993.705675] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.706337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.706337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.706337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.706521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.718021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: IN_PROGRESS for 2s [ 994.652707] env[65319]: INFO networking_nsxv3.common.synchronization [None req-22b236ff-c188-4ed8-ab0c-a191897c06bb tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 994.653472] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 994.653841] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.654053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.654053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.654512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.654859] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.760296] env[65319]: INFO networking_nsxv3.common.synchronization [None req-2565007c-4243-4f69-a6dc-0c7d4a59006a tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 994.760296] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 994.760296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.760296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.086041] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: SUCCESS [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.086041] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.086041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.086041] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.177261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.177553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.177662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.177989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.178170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.178312] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 already deleted. [ 995.178435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.178670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.178891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.179042] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.591737] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.591984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.592140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.592461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.592728] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.592891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.593084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.593286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.593444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.593596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.593846] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.594044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.594134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.594364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.594637] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.594757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.594866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.595115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.595257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.595504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.595677] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.700144] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.700424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.700981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.700981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.700981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.700981] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 already deleted. [ 995.701761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.727961] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0a6c793-0760-435d-be82-33d755948f79 in Status: SUCCESS [ 995.728170] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0a6c793-0760-435d-be82-33d755948f79 deletion is rescheduled due to dependency. [ 995.728285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.100519] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdec9d4c-9475-4260-8af9-fba7e4820934: rpc.has_security_group_logging(os_id): False [ 996.121320] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.121320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.121628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.121628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.122171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.122171] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.122171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.122400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.122400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.122492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.122690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.122845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.122902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.127424] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.127424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.127424] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 is going to be created. [ 996.198111] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.199141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.199141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.199141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.199141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.216636] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: IN_PROGRESS for 2s [ 997.109092] env[65319]: INFO networking_nsxv3.common.synchronization [req-59f1cf5c-1b33-481e-928c-51c87a476de2 req-b439aefe-75ad-48e6-b09f-71aee466aa01 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 997.109647] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 997.110115] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.110115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.110115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.110302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.110456] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.110554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.110607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.110755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.110832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.110921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.524828] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.524828] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.524828] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.525054] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.525266] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.525600] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.525713] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.525888] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.526205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.526348] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.526487] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.526604] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.526714] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.526825] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.526929] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.527071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.546032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.546212] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.546260] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.546415] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.546776] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-e124e626-b93f-4ab2-ba38-dae83ff2a77f taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.546956] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.547100] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.547535] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.547535] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e124e626-b93f-4ab2-ba38-dae83ff2a77f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.612628] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.613215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.613318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.613828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.614467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.614856] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.614982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.615131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.615513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.615616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.615808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 997.644286] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.644441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.644512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.644714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.644851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.656702] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 997.660337] env[65319]: INFO networking_nsxv3.common.synchronization [req-ea0ff3f2-3384-4ceb-abd6-f910b48d153a req-1aa990b0-3ec2-41ed-9855-56d647753919 tempest-TenantUsagesTestJSON-2110921962 tempest-TenantUsagesTestJSON-2110921962-project-member] Enqueued Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 997.660806] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGHEST for action security_group_members [ 997.661817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.661817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.661817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.661817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.661817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.661817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.661817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.662171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.662171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.662171] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.050502] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.050738] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.050865] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.051185] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.051341] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.051500] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port e124e626-b93f-4ab2-ba38-dae83ff2a77f not found, creating... [ 998.051774] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.051974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.052066] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.052707] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.052890] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.053633] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.053633] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.053633] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.053974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.054653] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.054653] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: e124e626-b93f-4ab2-ba38-dae83ff2a77f is going to be created. [ 998.077537] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.077828] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.077894] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.078149] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.078378] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.078642] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.164099] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.164471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.164471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.164546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.164641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.164852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.164961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.165037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.165244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.165325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.165473] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 is going to be updated. [ 998.209938] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.210489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.210631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.227778] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: IN_PROGRESS for 2s [ 998.230916] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: SUCCESS [ 998.231174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.817104] env[65319]: INFO networking_nsxv3.common.synchronization [req-59f1cf5c-1b33-481e-928c-51c87a476de2 req-92d2d123-2966-4f06-aaa4-e5bbfd3474e4 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 998.817218] env[65319]: INFO networking_nsxv3.common.synchronization [req-59f1cf5c-1b33-481e-928c-51c87a476de2 req-92d2d123-2966-4f06-aaa4-e5bbfd3474e4 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 998.817320] env[65319]: INFO networking_nsxv3.common.synchronization [req-59f1cf5c-1b33-481e-928c-51c87a476de2 req-92d2d123-2966-4f06-aaa4-e5bbfd3474e4 service nova] Enqueued Resource ID: e124e626-b93f-4ab2-ba38-dae83ff2a77f with Priority: HIGHEST for action port [ 998.818234] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 998.818234] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 998.818234] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e124e626-b93f-4ab2-ba38-dae83ff2a77f with Priority: HIGHEST for action port [ 998.818427] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.818580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.818635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.818816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.818949] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.819814] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.819912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.820480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e124e626-b93f-4ab2-ba38-dae83ff2a77f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.820480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.820480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.820480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.820757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e124e626-b93f-4ab2-ba38-dae83ff2a77f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.323166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.323500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.323500] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e124e626-b93f-4ab2-ba38-dae83ff2a77f with status ACTIVE [ 999.323706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.323868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.323957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.324226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.324337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.324537] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.324664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.324746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.324924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.325083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.325200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.325295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.325346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.325513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.325606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.325757] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e124e626-b93f-4ab2-ba38-dae83ff2a77f is going to be updated. [ 999.351965] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.351965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.351965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.351965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.352235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.352235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e124e626-b93f-4ab2-ba38-dae83ff2a77f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.675938] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 999.676133] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 999.676251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.676442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.676677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.676885] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.677121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.677121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.677250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.677331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.677426] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.181647] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.239173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 in Status: SUCCESS [ 1000.239487] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 deletion is rescheduled due to dependency. [ 1000.239744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.620534] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e4bff244-70d3-4c5f-9565-150f309fa757 tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1000.621126] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1000.621475] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.621573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.621635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.621842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.621918] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.684394] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.720110] env[65319]: INFO networking_nsxv3.common.synchronization [None req-5b6922c5-795b-4343-bdd5-55ef6bebd0b0 tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1000.720665] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1000.720994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.721511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.142987] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.143438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.143438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.143519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.143557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.143881] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 already deleted. [ 1001.143881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.143881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.144053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.144104] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.187193] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.187618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.187618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.187841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.187944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.188064] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1001.217577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.217752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.217815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.218054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.218231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.229543] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1001.665545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.665941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.665941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.666146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.666290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.666422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 already deleted. [ 1001.666554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.306140] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-9dc8d6e6-658f-4f84-81c7-8329f1c7d560 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1002.306689] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1002.308352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.309031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.309130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.310310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.310605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.310771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.310856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.311110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.311262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.311398] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.675990] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-809af6a2-d553-4f7a-9e1d-1582967f8247 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1002.676982] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1002.676982] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.676982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.814869] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.814869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.814869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.815142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.815142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.815305] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.815555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.815635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.815805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.815888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.815979] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1002.845685] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.845866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.845956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.846205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.846379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.857323] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1003.046390] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.046603] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-914" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.046731] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-914" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.047092] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-914" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.047365] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.048155] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.048155] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.048318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.048474] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.048599] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.048765] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.048861] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.048982] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.049086] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.049191] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.049324] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.073290] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.073493] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.073606] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.073770] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-914" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.074102] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.074276] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.074395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.074707] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.074852] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3632ed6b-ba0c-4e90-bbc6-3da253e3657e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.239588] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1003.239819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.239991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.240226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.240419] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.240540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.240603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.240759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.240838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.240922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.241021] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.578056] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.578221] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.578386] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.578759] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.578966] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.579129] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 3632ed6b-ba0c-4e90-bbc6-3da253e3657e not found, creating... [ 1003.579473] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.579731] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.579922] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.580198] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.580510] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.580667] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.580819] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.580941] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.581164] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.581297] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.581573] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 3632ed6b-ba0c-4e90-bbc6-3da253e3657e is going to be created. [ 1003.601119] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.601334] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.601461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.602028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.602182] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.602812] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.746042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.746042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.746042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.747236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.747236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.747236] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.138958] env[65319]: INFO networking_nsxv3.common.synchronization [req-49d318c0-7612-407f-89d2-ae42a510d68d req-09a98593-2b13-4111-887d-fa4829fc7267 tempest-ServerGroupTestJSON-820323969 tempest-ServerGroupTestJSON-820323969-project-member] Enqueued Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 1004.139497] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGHEST for action security_group_members [ 1004.139802] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.139923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.140050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.140244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.140425] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.140505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.140745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.140745] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.140908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.140908] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.251503] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 1004.269550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.269712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.269806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.270013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.270115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.270326] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.270878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.270878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.270878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.270878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.270878] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.271201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.271201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.271201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.271307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.271400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.271519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.271554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.271677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.271750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.271834] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1004.336329] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.336624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.337042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.337042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.337142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.350173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1004.353612] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-f274136b-2f99-4068-ab18-9723b2d61483 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 1004.353786] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-f274136b-2f99-4068-ab18-9723b2d61483 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1004.354074] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-f274136b-2f99-4068-ab18-9723b2d61483 service nova] Enqueued Resource ID: 3632ed6b-ba0c-4e90-bbc6-3da253e3657e with Priority: HIGHEST for action port [ 1004.354248] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 1004.354391] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1004.354490] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3632ed6b-ba0c-4e90-bbc6-3da253e3657e with Priority: HIGHEST for action port [ 1004.355096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.355222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.355291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.355517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.355615] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.356428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.356559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.356741] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.356845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.356926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.357516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.357601] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3632ed6b-ba0c-4e90-bbc6-3da253e3657e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.646023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.646023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.646023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.646023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 is going to be updated. [ 1004.659812] env[65319]: INFO networking_nsxv3.common.synchronization [req-10406720-8be2-48f1-bfd9-4ce21c91ab8d req-b41f4555-50e6-472a-a206-91cc6b1c8832 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1004.660668] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1004.660924] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.661124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.661243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.661526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.661757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.661921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.662071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.662283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.662417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.662562] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.675394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.675766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.675766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.676144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.677129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.686607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: IN_PROGRESS for 2s [ 1004.862016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.862016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.862016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3632ed6b-ba0c-4e90-bbc6-3da253e3657e with status ACTIVE [ 1004.862016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.862016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.862016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.862016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.862016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.862609] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.862609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.862609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.862609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.862609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.862783] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.862828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.862879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.863025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.863094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.863175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3632ed6b-ba0c-4e90-bbc6-3da253e3657e is going to be updated. [ 1004.868670] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1004.869703] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea deletion is rescheduled due to dependency. [ 1004.869703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.869703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.869703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.869703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.869958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.870087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.870282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.870396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.870744] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.889016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.889016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.889016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.889016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.889016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.889016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3632ed6b-ba0c-4e90-bbc6-3da253e3657e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.008786] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.008953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.008953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.009315] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.010008] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.010193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.010320] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.010603] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.010759] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.010966] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.011092] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.011204] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.011868] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.011868] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.011868] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.011868] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.031226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.031384] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.031518] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.031700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.032077] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-e034cf8d-cec5-4a80-aecf-a74901f80a87 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.032295] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.032426] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.032758] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.032918] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e034cf8d-cec5-4a80-aecf-a74901f80a87',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.164607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.164607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.164743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.164934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.165033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.165267] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.165378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.165450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.165631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.165702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.165789] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 already deleted. [ 1005.165900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.191339] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.191566] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-111" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.191669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-111" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.192057] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-111" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.192398] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.192572] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.192712] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.192941] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.193119] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.193384] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.193502] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.193862] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.193862] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.193862] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.194094] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.194249] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.216873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.217082] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.217170] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.217343] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-111" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.217683] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-913f95ad-2987-4bcb-84a7-3ee5498f069a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.217882] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.218011] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.218310] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.218609] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('913f95ad-2987-4bcb-84a7-3ee5498f069a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.373380] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.535040] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.535299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.535427] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.535880] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.535983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.536145] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port e034cf8d-cec5-4a80-aecf-a74901f80a87 not found, creating... [ 1005.536420] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.536608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.536746] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.536973] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.537121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.537430] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.537553] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.537668] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.537870] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.537997] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.538146] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: e034cf8d-cec5-4a80-aecf-a74901f80a87 is going to be created. [ 1005.557050] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.557339] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.557393] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.557657] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.557886] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.558125] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.721445] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.721445] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.721622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.721928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.722100] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.722261] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 913f95ad-2987-4bcb-84a7-3ee5498f069a not found, creating... [ 1005.722551] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.722738] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.722862] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.723196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.723378] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.723727] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.723897] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.724030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.724687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.724687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.724687] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 913f95ad-2987-4bcb-84a7-3ee5498f069a is going to be created. [ 1005.749022] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.749313] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.749398] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.749652] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.749881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.750178] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.875039] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.269070] env[65319]: INFO networking_nsxv3.common.synchronization [req-10406720-8be2-48f1-bfd9-4ce21c91ab8d req-5f9215fe-997a-4f06-bd0a-db91ebfad2d7 service nova] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 1006.269260] env[65319]: INFO networking_nsxv3.common.synchronization [req-10406720-8be2-48f1-bfd9-4ce21c91ab8d req-5f9215fe-997a-4f06-bd0a-db91ebfad2d7 service nova] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1006.269401] env[65319]: INFO networking_nsxv3.common.synchronization [req-10406720-8be2-48f1-bfd9-4ce21c91ab8d req-5f9215fe-997a-4f06-bd0a-db91ebfad2d7 service nova] Enqueued Resource ID: e034cf8d-cec5-4a80-aecf-a74901f80a87 with Priority: HIGHEST for action port [ 1006.269902] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_rules [ 1006.270059] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1006.270164] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e034cf8d-cec5-4a80-aecf-a74901f80a87 with Priority: HIGHEST for action port [ 1006.270438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.270559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.270628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.270832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.270938] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.271736] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.271923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.272097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.272247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.272341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.272399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.272587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.272690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.272818] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.274630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-e034cf8d-cec5-4a80-aecf-a74901f80a87 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.274630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.274833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.275414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.275414] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e034cf8d-cec5-4a80-aecf-a74901f80a87',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.368747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1006.369035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.377053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.377218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.377265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.377481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.377568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.377662] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1006.406993] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.407155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.407282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.407427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.407599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.416295] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1006.481437] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-6a8a2b28-cdfb-4dec-9f9f-a52574452597 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 1006.481743] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-6a8a2b28-cdfb-4dec-9f9f-a52574452597 service nova] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1006.481743] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3a452c1-1114-4232-9d24-0f62d140edb7 req-6a8a2b28-cdfb-4dec-9f9f-a52574452597 service nova] Enqueued Resource ID: 913f95ad-2987-4bcb-84a7-3ee5498f069a with Priority: HIGHEST for action port [ 1006.482342] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_rules [ 1006.482543] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1006.482588] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 913f95ad-2987-4bcb-84a7-3ee5498f069a with Priority: HIGHEST for action port [ 1006.482904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.482979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.483181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.483266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.483542] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-913f95ad-2987-4bcb-84a7-3ee5498f069a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.483655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.483748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.483914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.484027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('913f95ad-2987-4bcb-84a7-3ee5498f069a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.697884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdec9d4c-9475-4260-8af9-fba7e4820934 in Status: SUCCESS [ 1006.698791] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 deletion is rescheduled due to dependency. [ 1006.698997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.777091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.777855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.779162] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.779162] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e034cf8d-cec5-4a80-aecf-a74901f80a87 with status ACTIVE [ 1006.779446] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.779446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.779446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.779607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.779985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.779985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.779985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.779985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.780793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.780793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.780793] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.780793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.782379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.782678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.782823] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.782942] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e034cf8d-cec5-4a80-aecf-a74901f80a87 is going to be updated. [ 1006.814409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.814593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.814648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.816631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.816631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.816631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e034cf8d-cec5-4a80-aecf-a74901f80a87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.986948] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 913f95ad-2987-4bcb-84a7-3ee5498f069a with status ACTIVE [ 1006.987215] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.987318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.987357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.990336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.990449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.990707] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.990837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.990902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.991282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.991282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.991753] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.991753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.991753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.991753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.991753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.991932] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 913f95ad-2987-4bcb-84a7-3ee5498f069a is going to be updated. [ 1007.025667] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.025667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.025667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.025667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.025667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.025667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-913f95ad-2987-4bcb-84a7-3ee5498f069a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.285264] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.787805] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.787966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.788071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.788293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.788385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.788486] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 is going to be created. [ 1007.812989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.813170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.813254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.813534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.813737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.826691] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: UNINITIALIZED for 2s [ 1008.427604] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1008.427604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.427604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.428503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.428503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.428503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.428503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.428503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.428682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.428716] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.834132] env[65319]: INFO networking_nsxv3.common.synchronization [req-a9854c3e-bc22-4154-a48a-96c7910de938 req-db42cd12-7d89-45f9-aee5-ce33d4305345 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1008.834801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1008.835022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.835182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.835271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.836150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.836150] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.836150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.836150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.836150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.836150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.836421] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.931264] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.181279] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.181446] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.181446] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.181716] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.181977] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.182147] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.182267] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.182587] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.182795] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.183025] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.183224] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.183357] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.183357] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.183707] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.183707] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.183919] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.205019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.205214] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.205354] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.205588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.207036] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-56bfc137-f22e-455f-bb63-8ce64cafa1b0 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.207036] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.207036] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.207036] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.207036] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bfc137-f22e-455f-bb63-8ce64cafa1b0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.340404] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.434362] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.708953] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.709211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.709340] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.709627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.709790] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.709947] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 56bfc137-f22e-455f-bb63-8ce64cafa1b0 not found, creating... [ 1009.710228] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.710443] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.710524] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.710721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.710859] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.711190] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.711360] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.711640] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.711809] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.711963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.712173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 56bfc137-f22e-455f-bb63-8ce64cafa1b0 is going to be created. [ 1009.732166] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.732402] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.732532] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.732803] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.733060] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.733285] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.837248] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: SUCCESS [ 1009.837510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.837692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.837953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.838236] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.838361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.838425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.838608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.838674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.838750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.838856] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.842023] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.936344] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.936568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.936694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.936863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.936958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.937073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1009.966715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.966952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.966952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.967207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.967378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.977552] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1010.342318] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.345196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.345393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.345429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.345701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.345792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.345892] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1010.382841] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.382841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.382841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.382841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.382841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.393358] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1010.496866] env[65319]: INFO networking_nsxv3.common.synchronization [req-a9854c3e-bc22-4154-a48a-96c7910de938 req-9aee4259-4e55-4d56-afa0-8f390d31232a service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1010.497343] env[65319]: INFO networking_nsxv3.common.synchronization [req-a9854c3e-bc22-4154-a48a-96c7910de938 req-9aee4259-4e55-4d56-afa0-8f390d31232a service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1010.497343] env[65319]: INFO networking_nsxv3.common.synchronization [req-a9854c3e-bc22-4154-a48a-96c7910de938 req-9aee4259-4e55-4d56-afa0-8f390d31232a service nova] Enqueued Resource ID: 56bfc137-f22e-455f-bb63-8ce64cafa1b0 with Priority: HIGHEST for action port [ 1010.503613] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1010.503992] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1010.504133] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56bfc137-f22e-455f-bb63-8ce64cafa1b0 with Priority: HIGHEST for action port [ 1010.505837] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.505837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.505837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.505837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.505837] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.506413] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.506512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.506752] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-56bfc137-f22e-455f-bb63-8ce64cafa1b0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.506859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.506914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.507115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.507189] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56bfc137-f22e-455f-bb63-8ce64cafa1b0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.814236] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1010.814236] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1010.848468] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9a3208-9f97-4dae-ab4b-0e8e455efe41: rpc.has_security_group_logging(os_id): False [ 1010.869136] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.869307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.869493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.869773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.869963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.870313] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.870616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.870649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.871124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.871256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.871354] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 is going to be created. [ 1010.964311] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.965413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.965413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.965413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.965413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.977523] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: IN_PROGRESS for 2s [ 1011.011237] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.011237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.011237] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56bfc137-f22e-455f-bb63-8ce64cafa1b0 with status ACTIVE [ 1011.011507] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.011507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.011507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.011698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.011773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.012282] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.012282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.012282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.012282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.012499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.012499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.012577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.012611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.012756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.012829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.012913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56bfc137-f22e-455f-bb63-8ce64cafa1b0 is going to be updated. [ 1011.049503] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.049716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.049760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.049980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.050133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.050293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56bfc137-f22e-455f-bb63-8ce64cafa1b0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.262183] env[65319]: INFO networking_nsxv3.common.synchronization [req-a70f3e9a-607c-431d-ae2b-8be684043f7b req-e3e550f5-0114-415c-9ddb-078d8a9fc19e tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1011.262183] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1011.262183] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.262183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.262183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.262183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.262737] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.263119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.263373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.265065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.265065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.265065] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.645243] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.645609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.645723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.646207] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.646540] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.646691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.646816] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.647043] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.647191] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.647415] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.647544] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.647612] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.647722] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.647895] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.648044] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.648192] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.669258] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.669438] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.669576] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.669750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-613" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.670075] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.670251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.670369] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.670690] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.670842] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.767528] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.767650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.767731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.767948] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.768056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.768254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.768348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.768413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.768566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.768636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.768720] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 already deleted. [ 1011.768786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.988167] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1011.988405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.988595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.988841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.988995] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.989375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.989375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.989375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.989490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.989490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.989623] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.990448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.990612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.990771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.990893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.990938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.992365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.992365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.992365] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.175922] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.176329] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.176589] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.177080] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.177302] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.177569] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 not found, creating... [ 1012.177999] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.178278] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.178483] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.178830] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.179629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.180086] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.180366] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.180588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.181905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.181905] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.181905] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 is going to be created. [ 1012.202580] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.202730] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.203311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.203311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.203468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.203687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.405201] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1012.405201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.405661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.405846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.405971] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.406069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.406134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.406398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.406398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.406593] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.492960] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.493237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.493373] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.908564] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.935975] env[65319]: INFO networking_nsxv3.common.synchronization [req-a70f3e9a-607c-431d-ae2b-8be684043f7b req-00659f58-2cce-4590-a708-eef66a249c1d service nova] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 1012.936221] env[65319]: INFO networking_nsxv3.common.synchronization [req-a70f3e9a-607c-431d-ae2b-8be684043f7b req-00659f58-2cce-4590-a708-eef66a249c1d service nova] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1012.936412] env[65319]: INFO networking_nsxv3.common.synchronization [req-a70f3e9a-607c-431d-ae2b-8be684043f7b req-00659f58-2cce-4590-a708-eef66a249c1d service nova] Enqueued Resource ID: 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 with Priority: HIGHEST for action port [ 1012.937174] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_rules [ 1012.937383] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1012.937496] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 with Priority: HIGHEST for action port [ 1012.937876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.937968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.938095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.938347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.938458] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.939424] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.939537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.940279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.940383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.940594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.940748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.940846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.941267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.941378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.941475] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.944763] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.944953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.945078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.945351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.945482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.990389] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: SUCCESS [ 1012.990681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.996218] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.411282] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.445892] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.448190] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 with status ACTIVE [ 1013.448406] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.448533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.448600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.448816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.448906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.449605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.449605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.449605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.449605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.449605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.449835] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.449835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.449915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.450134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.450134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.450275] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2 is going to be updated. [ 1013.451335] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.451553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.472950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.473272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.473272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.473403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.473532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.473692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54ee3cf4-3fb6-4770-bd52-c3f1e7e4b4b2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.499398] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.499532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.499532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.499703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.499795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.499890] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1013.533782] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.533978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.533978] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.534211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.534357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.542938] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1013.913679] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.914053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.914053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.914177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.914263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.914359] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1013.950297] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.950297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.950297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.950297] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.950601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.950642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.963353] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1014.453170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.453400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.453739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.453739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.453806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.453887] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 is going to be created. [ 1014.481032] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.481032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.481032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.481032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.481032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.491784] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: UNINITIALIZED for 2s [ 1014.670723] env[65319]: INFO networking_nsxv3.common.synchronization [req-4b7ad290-9006-4653-aaa7-3548288ce5a9 req-3f96eb9b-5860-4bad-91ac-f86d297780a6 tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1014.671276] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1014.671577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.671694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.671760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.671968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.672607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.672753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.672802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.673444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.673444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.673444] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.175281] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.175817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.175817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.176075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.176221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.176522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.176668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.176755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.176960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.177111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.177243] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1015.213908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.214076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.214076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.214491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.214491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.229211] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1015.552847] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1015.553098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.553278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.553546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.553758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.553879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.554202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.554451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.554548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.554645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.554820] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.554925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.554988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.555801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.555892] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.557440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.557440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.557440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.557440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.557440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.557440] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.976927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1015.977157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.977303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.977844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.978069] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.978069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.978189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.978896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.978896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.978896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.978896] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.060679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f47eb94-bdf5-494d-a378-78951389d1ea: rpc.has_security_group_logging(os_id): False [ 1016.082539] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.082717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.082809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.083085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.083204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.083513] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.083657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.083740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.083946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.084309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.084428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.084507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.084685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.084774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.085045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.085174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.085259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.085410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.085491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.085602] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1016.170391] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.171718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.171718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.171718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.171718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.200546] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1016.263338] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7c4fe59-de95-4620-a706-4c39ca542ffc req-4356c9bb-5e55-4249-b614-1d78e876b51e tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1016.264062] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1016.264439] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.264602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.264670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.264927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.267382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.267382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.267382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.267382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.267382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.267382] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.481846] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.482055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.482176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.482391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.482561] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.482691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.482769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.482929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.483032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.483157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.483436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.483436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.483567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.483698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.483810] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.483954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.484085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.484236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.484319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.484429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.484728] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.505686] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: SUCCESS [ 1016.506063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.506205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.506351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.506579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.507153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.507234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.507458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.507535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.507611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.507792] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.681739] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.682009] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.682137] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.682413] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.682701] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.684203] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.684348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.684641] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.684791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.685016] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.685140] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.685247] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.685353] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.685470] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.685607] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.685758] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.709346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.709736] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.709886] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.710159] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.710507] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-2223ce3c-4091-40da-b4e8-054c3b3c3432 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.710912] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.710912] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.711386] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.711550] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2223ce3c-4091-40da-b4e8-054c3b3c3432',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.769689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.770100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.770100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.770343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.770400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.770644] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.770752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.770813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.770974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.771069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.771213] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 already deleted. [ 1016.771304] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.990357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1017.011183] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.011447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.011447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.011675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.011733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.011967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.012082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.012142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.012300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.012395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.012590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.012688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.012746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.012946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.013238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.013386] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.013628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.013628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.013738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.013738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.013878] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1017.015100] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.100352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.100501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.100561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.100806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.101133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.144492] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1017.214030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.214422] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.214422] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.214824] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.215014] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.215182] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 2223ce3c-4091-40da-b4e8-054c3b3c3432 not found, creating... [ 1017.215475] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.215760] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.215881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.216267] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.216371] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.216700] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.216896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.217053] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.217290] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.217554] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.217724] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 is going to be created. [ 1017.242546] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1017.242774] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 1017.242925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.257234] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.257559] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.257816] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.258193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.258544] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.258885] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.286216] env[65319]: INFO networking_nsxv3.common.synchronization [None req-124d366c-21dc-44e7-ac72-49850fad5da8 None None] Enqueued Resource ID: 245a37db-c53e-4a1b-ba22-17d7354752c5 with Priority: HIGHEST for action port [ 1017.286911] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245a37db-c53e-4a1b-ba22-17d7354752c5 with Priority: HIGHEST for action port [ 1017.289038] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-245a37db-c53e-4a1b-ba22-17d7354752c5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.289038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245a37db-c53e-4a1b-ba22-17d7354752c5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.289038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245a37db-c53e-4a1b-ba22-17d7354752c5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.289038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245a37db-c53e-4a1b-ba22-17d7354752c5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.289038] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245a37db-c53e-4a1b-ba22-17d7354752c5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.517684] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e04b5099-c245-45bb-ba03-28eba19d17c1: rpc.has_security_group_logging(os_id): False [ 1017.538614] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.539785] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.539785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.540285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.540285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 is going to be created. [ 1017.611027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.611027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.611027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.611027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.611027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.623715] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: IN_PROGRESS for 2s [ 1017.793612] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 245a37db-c53e-4a1b-ba22-17d7354752c5 [ 1017.793612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.793612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.793612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.793612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.793612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.793612] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:245a37db-c53e-4a1b-ba22-17d7354752c5 already deleted. [ 1017.793612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245a37db-c53e-4a1b-ba22-17d7354752c5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.016987] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7c4fe59-de95-4620-a706-4c39ca542ffc req-949957d9-c674-4d62-b713-5b76d045f657 service nova] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1018.017195] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7c4fe59-de95-4620-a706-4c39ca542ffc req-949957d9-c674-4d62-b713-5b76d045f657 service nova] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1018.017332] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7c4fe59-de95-4620-a706-4c39ca542ffc req-949957d9-c674-4d62-b713-5b76d045f657 service nova] Enqueued Resource ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 with Priority: HIGHEST for action port [ 1018.017854] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1018.019968] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1018.019968] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 with Priority: HIGHEST for action port [ 1018.019968] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.020204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.020204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.020351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.020435] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.021372] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.021512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.021592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.021733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.024757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.024757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.024757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2223ce3c-4091-40da-b4e8-054c3b3c3432 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.024757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.024757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2223ce3c-4091-40da-b4e8-054c3b3c3432',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.237143] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1018.238582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.238582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.238582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.238582] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.525639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.526380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.530394] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.530394] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2223ce3c-4091-40da-b4e8-054c3b3c3432 with status ACTIVE [ 1018.530394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.530394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.530394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.530394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.531335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.534458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 is going to be updated. [ 1018.560713] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.561216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.561365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.561582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.561780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.561952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.715797] env[65319]: INFO networking_nsxv3.common.synchronization [None req-cf6a0ea1-23b1-498e-a92f-cd37149c2a2a tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1018.716475] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1018.716833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.717642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.717707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.718059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.718187] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.743580] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.743775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.743857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.744162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.744388] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.744523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.744608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.744798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.744898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.745026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.745135] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.882107] env[65319]: INFO networking_nsxv3.common.synchronization [None req-940147ff-66aa-4a73-87db-4326b5e4e40f tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1018.883044] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1018.883603] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.883784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.037365] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.164361] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1019.164361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.242685] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.243529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.243529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.243717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.243717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.243793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 already deleted. [ 1019.243884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.244072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.244269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.244368] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.249377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.249377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.249377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.249377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.249377] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.249377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.249377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.249686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.250300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.250842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.251135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.251327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.251327] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.251989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.252147] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.252269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.254024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.254024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.254024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.254024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.254024] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.543782] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.544049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.544154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.544399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.544913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.545086] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be created. [ 1019.573695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.575195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.575301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.575620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.575834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.589224] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: UNINITIALIZED for 2s [ 1019.639070] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: SUCCESS [ 1019.639070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.660952] env[65319]: INFO networking_nsxv3.common.synchronization [None req-2bfc2de1-b97e-40fe-afe6-477582e8e81a None None] Enqueued Resource ID: 85196df4-551d-43c4-9e80-ad4f5a442ad4 with Priority: HIGHEST for action port [ 1019.661501] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85196df4-551d-43c4-9e80-ad4f5a442ad4 with Priority: HIGHEST for action port [ 1019.661802] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-85196df4-551d-43c4-9e80-ad4f5a442ad4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.661923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85196df4-551d-43c4-9e80-ad4f5a442ad4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.662222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85196df4-551d-43c4-9e80-ad4f5a442ad4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.662306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85196df4-551d-43c4-9e80-ad4f5a442ad4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.662657] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85196df4-551d-43c4-9e80-ad4f5a442ad4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.755173] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f47eb94-bdf5-494d-a378-78951389d1ea: rpc.has_security_group_logging(os_id): False [ 1019.771016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.771184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.771257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.771861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.771861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.771861] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 already deleted. [ 1019.771861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.772725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.772893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.772977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.776241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.776568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.781762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.782140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.782140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.785057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.785057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.785057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.785057] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1019.879086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.879086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.879086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.879551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.879551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.903044] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1020.164012] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85196df4-551d-43c4-9e80-ad4f5a442ad4 [ 1020.164237] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.164371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.164431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.164671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.164765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.164860] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85196df4-551d-43c4-9e80-ad4f5a442ad4 already deleted. [ 1020.164943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85196df4-551d-43c4-9e80-ad4f5a442ad4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.723458] env[65319]: INFO networking_nsxv3.common.synchronization [req-54e32082-83e7-4520-87f9-ec728cbe9fde req-45373900-373b-4741-bf65-6869943bf829 tempest-ServersTestBootFromVolume-1104516695 tempest-ServersTestBootFromVolume-1104516695-project-member] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1020.724026] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1020.724607] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.724731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.724891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.725474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.725474] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.725474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.725828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.725828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.725828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.725932] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.138516] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.138516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-996" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.138516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-996" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.138516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-996" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.138516] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.138516] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.139229] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.139433] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.139587] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.139786] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.139900] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.140037] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.140148] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.140602] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.140602] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.140602] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.161747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.161931] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.162084] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.162987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-996" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162987] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-bb7e13b7-305a-4a6f-b919-83a67d523d5b taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.163528] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.163528] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb7e13b7-305a-4a6f-b919-83a67d523d5b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.229868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.229868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.229868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.230292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.230292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.230292] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 already deleted. [ 1021.230292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.598730] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: SUCCESS [ 1021.598730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.598730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.598730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.599562] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.599562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.599562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.599562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.599562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.599562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.599562] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.667383] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.667940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.667940] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.668289] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.668514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.668735] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port bb7e13b7-305a-4a6f-b919-83a67d523d5b not found, creating... [ 1021.669109] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.669345] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.669496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.669784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.670143] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.670559] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.670787] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.670923] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.671237] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.671485] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.671682] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: bb7e13b7-305a-4a6f-b919-83a67d523d5b is going to be created. [ 1021.695804] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.695804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.695804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.695804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.695804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.696120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.735333] env[65319]: INFO networking_nsxv3.common.synchronization [req-04391de4-5a07-465a-8861-c6956a11c241 req-ec9c44fb-20e4-4872-91b7-d05e1e86b843 tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1021.735984] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1021.736699] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.736854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.736919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.737205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.737430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.737550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.737624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.737796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.737904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.738020] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.922397] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1021.922567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.005822] env[65319]: INFO networking_nsxv3.common.synchronization [req-04391de4-5a07-465a-8861-c6956a11c241 req-3ccf9f5c-fee1-4063-aa4f-9069e98f18fc tempest-ServersTestMultiNic-1243935937 tempest-ServersTestMultiNic-1243935937-project-member] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1022.006218] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGHEST for action security_group_members [ 1022.006624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.006779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.102109] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.240485] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [req-54e32082-83e7-4520-87f9-ec728cbe9fde req-19a6b6ab-249d-489a-aee1-e8b080819497 service nova] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [req-54e32082-83e7-4520-87f9-ec728cbe9fde req-19a6b6ab-249d-489a-aee1-e8b080819497 service nova] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [req-54e32082-83e7-4520-87f9-ec728cbe9fde req-19a6b6ab-249d-489a-aee1-e8b080819497 service nova] Enqueued Resource ID: bb7e13b7-305a-4a6f-b919-83a67d523d5b with Priority: HIGHEST for action port [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_rules [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1022.502023] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb7e13b7-305a-4a6f-b919-83a67d523d5b with Priority: HIGHEST for action port [ 1022.502023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.502023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.502023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.502758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.502758] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.504913] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.505069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.505111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.505314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.505789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.505789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.505789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.506073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.506162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.506269] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.507546] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb7e13b7-305a-4a6f-b919-83a67d523d5b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.507546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.507546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.507739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.508383] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb7e13b7-305a-4a6f-b919-83a67d523d5b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.604486] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 168faf57-13be-4d1b-8a5c-4618e12dde52: rpc.has_security_group_logging(os_id): False [ 1022.625890] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.626123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.626202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.626563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.626723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.627073] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.627211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.627285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.627493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.627594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.627733] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be created. [ 1022.709544] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.709845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.709845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.710181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.710404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.728365] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: IN_PROGRESS for 2s [ 1022.745987] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.010049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb7e13b7-305a-4a6f-b919-83a67d523d5b with status ACTIVE [ 1023.010049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.010049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.010049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.010396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.010396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.010536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.010642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.010707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.010851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.010960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.011133] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.011231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.011291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.011482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.011593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.011713] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb7e13b7-305a-4a6f-b919-83a67d523d5b is going to be updated. [ 1023.013007] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.014143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.014260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.043833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.044062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.044111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.044315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.044457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.044635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb7e13b7-305a-4a6f-b919-83a67d523d5b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.248945] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.249098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.249263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.249404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.249537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.249680] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1023.281750] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.281937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.281989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.282312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.282545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.295039] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1023.516937] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.929216] env[65319]: INFO networking_nsxv3.common.synchronization [req-82a90d93-c59c-49c8-8a14-7fa38910c8fd req-9a8fb70f-aef6-4d24-ac08-a24f6ad376cd tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1023.930280] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1023.930684] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.930942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.931011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.932026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.932026] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.932240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.932240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.932343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.932453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.933093] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.022652] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.022652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.022652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.022652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.022652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.022652] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 is going to be created. [ 1024.045423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.046047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.046374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.047012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.047781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.091085] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: UNINITIALIZED for 2s [ 1024.140258] env[65319]: INFO networking_nsxv3.common.synchronization [req-0ae2f600-dda1-47df-90e2-4236fbbe23d8 req-50e2b86c-f72c-44fe-b708-5d25722ec79d tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1024.141012] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1024.141419] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.142054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.142054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.142054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.142448] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.142448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.142448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.142655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.142789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.142924] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.373503] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.373709] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.373850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.374150] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.374424] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.374705] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.374705] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.374926] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.375104] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.375304] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.375421] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.375579] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.375696] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.375799] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.375911] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.376110] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.397657] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.398290] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.398290] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.398494] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.398761] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-f9df44f4-78f6-4fb0-9349-03b2e605b030 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.399448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.399448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.399692] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.399899] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9df44f4-78f6-4fb0-9349-03b2e605b030',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.435712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.435916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.435963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.436176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.436295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.436611] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.436751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.436820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.437010] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.437106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.437197] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be deleted. [ 1024.472428] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.472668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.472827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.473132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.473274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.473386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.645895] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.742667] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: SUCCESS [ 1024.742898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.902239] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.902585] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.902721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.903046] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.903204] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.903363] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port f9df44f4-78f6-4fb0-9349-03b2e605b030 not found, creating... [ 1024.903729] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.903935] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.904069] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.904318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.904455] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.904748] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.904912] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.905030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.905348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.905613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.905744] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 is going to be created. [ 1024.925890] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.926698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.926698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.926698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.926977] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.927260] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.147893] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.305039] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1025.305039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.305273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.305374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.305637] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.305977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.306163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.306317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.306485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.306645] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [req-82a90d93-c59c-49c8-8a14-7fa38910c8fd req-19686f9e-bc7d-4164-8265-4cce25d6692f service nova] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_rules [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [req-82a90d93-c59c-49c8-8a14-7fa38910c8fd req-19686f9e-bc7d-4164-8265-4cce25d6692f service nova] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [req-82a90d93-c59c-49c8-8a14-7fa38910c8fd req-19686f9e-bc7d-4164-8265-4cce25d6692f service nova] Enqueued Resource ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 with Priority: HIGHEST for action port [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_rules [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1025.635342] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 with Priority: HIGHEST for action port [ 1025.635342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.635342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.635342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.635342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.636506] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.638062] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.638850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.638850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.638850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.638850] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.639109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.639109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.639508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.639508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.639508] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.640259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9df44f4-78f6-4fb0-9349-03b2e605b030 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.640646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.640646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.640646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.641108] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9df44f4-78f6-4fb0-9349-03b2e605b030',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.650166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.650319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.650387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.650579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.650661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.650759] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1025.682954] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.683153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.683210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.683443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.683643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.694032] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1025.809225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.809481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.809554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.810157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.810157] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.810157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.810422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.810422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.810422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.810543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.810543] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be updated. [ 1025.860211] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.860211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.860211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.860211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.860211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.873944] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: IN_PROGRESS for 2s [ 1026.099283] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: SUCCESS [ 1026.099392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.099505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.100312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.100312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.100312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.100312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.100312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.100312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.100565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.100565] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.142828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.142828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.143042] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.143820] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9df44f4-78f6-4fb0-9349-03b2e605b030 with status ACTIVE [ 1026.144016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.144135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.144200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.144411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.144738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.144976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.145094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.145094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.145324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.145378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.145553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.145797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.145797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.145930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.145984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.146081] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 is going to be updated. [ 1026.168052] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.168416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.168416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.168553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.168711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.168967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.603140] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.648444] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.107450] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 282f1cfb-aa79-42a6-936b-877f8ae71035: rpc.has_security_group_logging(os_id): False [ 1027.127093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.127313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.127371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.127566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.127652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.127942] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.128046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.128107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.128506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.128611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.128753] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 is going to be created. [ 1027.151902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.152187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.152187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.152369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.152463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.152551] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be created. [ 1027.180085] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.180509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.180509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.180604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.180700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.193357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: UNINITIALIZED for 2s [ 1027.204373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.204560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.204609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.204832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.205047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.218343] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: IN_PROGRESS for 2s [ 1027.706069] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1027.706300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.885055] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f47eb94-bdf5-494d-a378-78951389d1ea in Status: SUCCESS [ 1027.885500] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea deletion is rescheduled due to dependency. [ 1027.885500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.942595] env[65319]: INFO networking_nsxv3.common.synchronization [req-b404ff22-a4b5-47d6-a709-b76fa46496d7 req-e708e8a2-95e6-4b53-81f6-ff6f5b874ef9 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1028.943234] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1028.943583] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.943963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.943963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.944132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.944261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.944390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.944473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.944657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.944770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.944891] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.204419] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 1029.204578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.205023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.205591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.205591] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.205591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.205818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.205818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.205902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.206519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.206519] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.229967] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: SUCCESS [ 1029.230215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.446801] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.447027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.447111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.447322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.468036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.468268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.468381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.468495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.468661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.468746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.468844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1029.496976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.497248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.497248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.497415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.497558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.506351] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1029.709658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.709895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.709975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.710262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.710404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.710515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.710617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.710816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.710986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.711106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.711262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.711391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.711490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.711676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.711840] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.711954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.712025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.712136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.712216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.712340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.712472] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.214539] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7: rpc.has_security_group_logging(os_id): False [ 1030.234852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.235024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.235074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.235308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.235395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.235578] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.235675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.235740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.236108] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.236235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.236527] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.236669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.236758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.237031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.237109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.237334] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.237464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.237548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.237735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.237836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.237948] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be created. [ 1030.303544] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.303735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.303735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.303991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.304195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.315670] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: IN_PROGRESS for 2s [ 1030.643390] env[65319]: INFO networking_nsxv3.common.synchronization [req-7feba342-e6a0-4157-8029-6a7c0c31038e req-06ec6d54-2adb-40fd-913c-189fdd98dfa4 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1030.643999] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1030.644686] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.644822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.644968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.645204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.645379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.645486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.645581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.645760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.645920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.646074] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.992339] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.992466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.992653] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.992981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.993272] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.993459] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.993576] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.993822] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.993963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.994182] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.994351] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.994404] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.994618] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.994618] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.994767] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.994824] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.015286] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.015469] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.015694] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.015977] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.016368] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-0d297e86-9014-49d2-9da3-4557fe1880f3 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.016503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.016626] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.016974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.017164] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d297e86-9014-49d2-9da3-4557fe1880f3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.148689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.148839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.148839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.149321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.149321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.149321] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.149545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.149545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.149613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.149719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.149825] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 already deleted. [ 1031.149871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.519340] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1031.519591] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa deletion is rescheduled due to dependency. [ 1031.519749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.520394] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.520674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.520879] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.521238] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.521477] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.521709] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 0d297e86-9014-49d2-9da3-4557fe1880f3 not found, creating... [ 1031.522116] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.522365] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.522656] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.522901] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.523139] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.523548] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.523883] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.524099] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.524620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.524620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.524755] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 0d297e86-9014-49d2-9da3-4557fe1880f3 is going to be created. [ 1031.546564] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.546883] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.547073] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.547357] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.547637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.547939] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.264371] env[65319]: INFO networking_nsxv3.common.synchronization [req-7feba342-e6a0-4157-8029-6a7c0c31038e req-e70e4c9c-8dc1-467b-ae82-b98331289e1c service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1032.264591] env[65319]: INFO networking_nsxv3.common.synchronization [req-7feba342-e6a0-4157-8029-6a7c0c31038e req-e70e4c9c-8dc1-467b-ae82-b98331289e1c service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1032.264736] env[65319]: INFO networking_nsxv3.common.synchronization [req-7feba342-e6a0-4157-8029-6a7c0c31038e req-e70e4c9c-8dc1-467b-ae82-b98331289e1c service nova] Enqueued Resource ID: 0d297e86-9014-49d2-9da3-4557fe1880f3 with Priority: HIGHEST for action port [ 1032.265344] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1032.265541] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1032.265659] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d297e86-9014-49d2-9da3-4557fe1880f3 with Priority: HIGHEST for action port [ 1032.265885] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.266682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.266682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.266682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.266682] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.267862] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.267862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.267862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.268131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.268203] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.268292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.268358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.268505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.268587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268699] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.270148] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d297e86-9014-49d2-9da3-4557fe1880f3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.270148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.270516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.270516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.270516] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d297e86-9014-49d2-9da3-4557fe1880f3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.338605] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 1032.338760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.772662] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.773797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.773922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.774114] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d297e86-9014-49d2-9da3-4557fe1880f3 with status ACTIVE [ 1032.774326] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.774708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.774708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.774708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.775774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.775774] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.775774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.775774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.775774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.775774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.777090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.777090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.777090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.777090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.777090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.777090] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d297e86-9014-49d2-9da3-4557fe1880f3 is going to be updated. [ 1032.797114] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.797296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.797375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.797570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.797707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.797862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d297e86-9014-49d2-9da3-4557fe1880f3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.279186] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.784324] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.784324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.784324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.784324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.784324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.784324] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be created. [ 1033.810366] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.810511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.810615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.810789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.810944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.822688] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: UNINITIALIZED for 2s [ 1033.925264] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a21c8e4-efdf-45a7-bd46-137f7ad2f0f6 req-7f9d4bdd-0254-4c18-82ed-5cf187e46103 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1033.926151] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1033.926703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.926703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.926703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.927243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.927243] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.927243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.927382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.927431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.927521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.927619] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.250132] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.250355] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.250567] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.250950] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.251381] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.251643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.251852] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.252205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.252430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.252758] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.252890] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.253054] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.253190] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.253304] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.253409] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.253543] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.275883] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.276210] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.276367] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.276546] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.276886] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.277064] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.277193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.277524] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.277702] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54034f16-85ad-4f22-9b5b-eb6ebf69cb25',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.431786] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.431988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.432101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.432400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.432523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.432789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.432926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.433028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.433239] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.433343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.433454] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 already deleted. [ 1034.433564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.780737] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.780954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.781118] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.781406] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.781644] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.781802] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 not found, creating... [ 1034.782080] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.782408] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.782531] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.782765] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.782903] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783221] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.783384] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.783499] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.783706] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.783867] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.783983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 is going to be created. [ 1034.804149] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.804660] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.804660] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.804756] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.804972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.805227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a21c8e4-efdf-45a7-bd46-137f7ad2f0f6 req-2c814654-9826-4c8e-936d-cb7c4d8c75bb service nova] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a21c8e4-efdf-45a7-bd46-137f7ad2f0f6 req-2c814654-9826-4c8e-936d-cb7c4d8c75bb service nova] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [req-1a21c8e4-efdf-45a7-bd46-137f7ad2f0f6 req-2c814654-9826-4c8e-936d-cb7c4d8c75bb service nova] Enqueued Resource ID: 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 with Priority: HIGHEST for action port [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_rules [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1035.628983] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 with Priority: HIGHEST for action port [ 1035.629879] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.630160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.630328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.630640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.630825] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.631824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.634019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.634019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.634019] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.636050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.636334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.636488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.636882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.637440] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54034f16-85ad-4f22-9b5b-eb6ebf69cb25',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.837308] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1035.837706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.837769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.837985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.838203] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.838483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.838566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.838764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.838865] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.839013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.839170] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.014497] env[65319]: INFO networking_nsxv3.common.synchronization [req-fa75dca8-6148-4e23-b1b4-b705c288d3e1 req-a1290705-438e-440a-8b11-06b8e58512ba tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1036.016226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGHEST for action security_group_members [ 1036.016403] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.016531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.016625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.016976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.017158] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.017289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.017377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.017528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.017631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.020165] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.064607] env[65319]: INFO networking_nsxv3.common.synchronization [req-fa75dca8-6148-4e23-b1b4-b705c288d3e1 req-a1290705-438e-440a-8b11-06b8e58512ba tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 with Priority: HIGHEST for action port [ 1036.065426] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 with Priority: HIGHEST for action port [ 1036.065752] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9df44f4-78f6-4fb0-9349-03b2e605b030 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.065878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.065936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.066365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.066462] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9df44f4-78f6-4fb0-9349-03b2e605b030',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.141577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.141577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.141747] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.143498] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 with status ACTIVE [ 1036.143712] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.143844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.144117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.144202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.144274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.144467] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.144642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.144642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.148167] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.148167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.148167] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54034f16-85ad-4f22-9b5b-eb6ebf69cb25 is going to be updated. [ 1036.172392] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.172681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.172775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.173072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.173244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.173420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54034f16-85ad-4f22-9b5b-eb6ebf69cb25" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.341923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.342278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.342335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.343201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.343201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.343201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.343201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.343507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.343507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.343718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.344127] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.344296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.344353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.344595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.344899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.345083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.345237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.345487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.345668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.345850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.346049] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.520301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.520555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.520555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.520798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.520891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.521569] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.521569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.521569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.521569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.521569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.521843] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be updated. [ 1036.562122] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.562282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.562355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.562557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.562705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.569094] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9df44f4-78f6-4fb0-9349-03b2e605b030 with status ACTIVE [ 1036.569455] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.569698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.569864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.570072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.570326] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.570728] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.570839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.570904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.571206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.571338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.571667] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.571834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.571938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.572348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.572510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.572625] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9df44f4-78f6-4fb0-9349-03b2e605b030 is going to be updated. [ 1036.575372] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: IN_PROGRESS for 2s [ 1036.602510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.602739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.602739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.603042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.603409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.603530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9df44f4-78f6-4fb0-9349-03b2e605b030" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.648702] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.849423] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95d83bf-87be-46fb-a121-6221d6adfa83: rpc.has_security_group_logging(os_id): False [ 1036.882449] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.882652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.882700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.882883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.882973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.883179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.883299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.883386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.883554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.883694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.883936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.884173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.884173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.884302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.884405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.884627] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.884727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.884790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.884967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.885093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.885224] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be created. [ 1036.948433] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.948639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.948711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.948960] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.949190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.961159] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1037.153547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.153694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.153895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.154039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.154127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.154291] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 is going to be created. [ 1037.181765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.181765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.181765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.182025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.182124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.195040] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: UNINITIALIZED for 2s [ 1038.585669] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 in Status: SUCCESS [ 1038.586031] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 deletion is rescheduled due to dependency. [ 1038.586180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.973291] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1038.973526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206155] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: SUCCESS [ 1039.206155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.206155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.206431] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.206500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.206539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.206947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.206947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207235] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.709330] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.216387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9017d4b0-791a-4ebd-9f2d-0db22fee76c4: rpc.has_security_group_logging(os_id): False [ 1040.240385] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.240551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.240625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.240857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.240963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.241250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.241363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.241424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.241584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.241662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.242073] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 is going to be created. [ 1040.309290] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.309481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.309559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.310369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.310369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.323906] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: IN_PROGRESS for 2s [ 1041.066699] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1041.066699] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1042.145502] env[65319]: INFO networking_nsxv3.common.synchronization [req-8421d17e-9808-45c3-a183-3980d9db31a1 req-15f8c971-27a7-45a6-bc18-864fc624539d tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1042.146251] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1042.146877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.146877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.146877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.147158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.147158] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.147268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.147308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.147678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.147781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.147875] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.339285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: SUCCESS [ 1042.339611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.528848] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.529142] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.529291] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.529594] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.529880] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.530048] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.530172] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.530437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.530613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.530875] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.531067] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.531206] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.531320] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.531436] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.531555] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.531717] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.560458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.560655] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.560817] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.561036] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-305" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.561363] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-d64bd85e-c0dc-41f9-9935-2b001d38fe92 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.561557] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.561692] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.562031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.562176] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64bd85e-c0dc-41f9-9935-2b001d38fe92',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.649986] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.650162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.650240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.650434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.650748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.650748] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.650876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.650991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.651080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.651233] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1042.680861] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.681057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.681057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.681270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.681418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.690498] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1043.064395] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.064660] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.064881] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.065340] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.065762] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.066045] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port d64bd85e-c0dc-41f9-9935-2b001d38fe92 not found, creating... [ 1043.066382] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.067055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.067055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.067383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.067383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.068772] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.068772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.068772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.068772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.068772] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.069126] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: d64bd85e-c0dc-41f9-9935-2b001d38fe92 is going to be created. [ 1043.093008] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.093311] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.094537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.094537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.094537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.094537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.807344] env[65319]: INFO networking_nsxv3.common.synchronization [req-8421d17e-9808-45c3-a183-3980d9db31a1 req-3e38d203-6d0e-4021-81f4-062e5ded27d4 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 1043.807670] env[65319]: INFO networking_nsxv3.common.synchronization [req-8421d17e-9808-45c3-a183-3980d9db31a1 req-3e38d203-6d0e-4021-81f4-062e5ded27d4 service nova] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1043.807670] env[65319]: INFO networking_nsxv3.common.synchronization [req-8421d17e-9808-45c3-a183-3980d9db31a1 req-3e38d203-6d0e-4021-81f4-062e5ded27d4 service nova] Enqueued Resource ID: d64bd85e-c0dc-41f9-9935-2b001d38fe92 with Priority: HIGHEST for action port [ 1043.810801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_rules [ 1043.810801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1043.810801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d64bd85e-c0dc-41f9-9935-2b001d38fe92 with Priority: HIGHEST for action port [ 1043.810801] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.810801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.810801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.810801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.810801] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.811250] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.811250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.811427] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-d64bd85e-c0dc-41f9-9935-2b001d38fe92 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.811554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.811628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.811846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.811934] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64bd85e-c0dc-41f9-9935-2b001d38fe92',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.314758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.314915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.315152] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d64bd85e-c0dc-41f9-9935-2b001d38fe92 with status ACTIVE [ 1044.315342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.315460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.315533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.315754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.315840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.316040] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.316141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.316240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.316422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.316511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.316703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.316809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.316881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.317034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.317122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.317219] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d64bd85e-c0dc-41f9-9935-2b001d38fe92 is going to be updated. [ 1044.341178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.341178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.341178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.341338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.341376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.341534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d64bd85e-c0dc-41f9-9935-2b001d38fe92" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.703019] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1044.703019] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.703019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.703019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.703743] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.204898] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.707635] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.209978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.210332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.210332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.210432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.210523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.210626] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1046.237775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.237907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.237981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.238525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.238525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.247417] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1046.293386] env[65319]: INFO networking_nsxv3.common.synchronization [req-94918dd0-751f-4a4a-adf1-295a1cea6b58 req-2b6f099c-e58c-4b82-9b22-80b13bccd777 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1046.294013] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1046.294328] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.294453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.294510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.294703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.294862] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.294962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.295029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.295174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.295260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.295354] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.631844] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.633010] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.633279] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.633696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.634110] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.634273] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.634431] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.636123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.636123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.636123] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.636123] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.636123] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.636123] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.636123] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.636123] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.636123] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.669484] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.669484] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1046.669484] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.669696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.670024] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-64a0db44-66f5-4d31-9db4-36db07b805c2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.674744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.674744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.674744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.674744] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64a0db44-66f5-4d31-9db4-36db07b805c2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.797810] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.175753] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.175952] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.176133] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.176490] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.176655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.176791] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 64a0db44-66f5-4d31-9db4-36db07b805c2 not found, creating... [ 1047.177073] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.177265] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.177437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.177668] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.177804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.178791] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.178791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.178791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.178791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.178791] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.179105] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 64a0db44-66f5-4d31-9db4-36db07b805c2 is going to be created. [ 1047.202619] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.202827] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.202946] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.203347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.203585] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.203813] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.300777] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.803791] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.803999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.804273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.804573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.804686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.804796] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1047.838853] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.839065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.839065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.839281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.839419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.848929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1047.942105] env[65319]: INFO networking_nsxv3.common.synchronization [req-94918dd0-751f-4a4a-adf1-295a1cea6b58 req-68d58d13-822c-49ff-a193-c3498679dcc4 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1047.942289] env[65319]: INFO networking_nsxv3.common.synchronization [req-94918dd0-751f-4a4a-adf1-295a1cea6b58 req-68d58d13-822c-49ff-a193-c3498679dcc4 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1047.942427] env[65319]: INFO networking_nsxv3.common.synchronization [req-94918dd0-751f-4a4a-adf1-295a1cea6b58 req-68d58d13-822c-49ff-a193-c3498679dcc4 service nova] Enqueued Resource ID: 64a0db44-66f5-4d31-9db4-36db07b805c2 with Priority: HIGHEST for action port [ 1047.942964] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1047.944437] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1047.944607] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64a0db44-66f5-4d31-9db4-36db07b805c2 with Priority: HIGHEST for action port [ 1047.944906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.945056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.945120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.945581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.945630] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.947862] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.948041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.948200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-64a0db44-66f5-4d31-9db4-36db07b805c2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.948309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.948450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.948576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.948636] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64a0db44-66f5-4d31-9db4-36db07b805c2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.275349] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1048.275618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.275820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.276110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.276413] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.276588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.276693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.277161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.277432] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.451225] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.451782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.451782] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64a0db44-66f5-4d31-9db4-36db07b805c2 with status ACTIVE [ 1048.451782] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.451938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.452107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.452381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.452541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.452791] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.452949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.453042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.453246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.453351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.453615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.453701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.453751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.453935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.454408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.454408] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64a0db44-66f5-4d31-9db4-36db07b805c2 is going to be updated. [ 1048.479662] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.479848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.479911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.480614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.480811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.480962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64a0db44-66f5-4d31-9db4-36db07b805c2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.780556] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.780770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.780816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.781027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.781226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.781358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.781427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.781587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.781674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.781761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.781908] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.782012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.782078] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.782216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.782356] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.782451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.782511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.782644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.782722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.782801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.782903] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.285911] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 848d35f9-8739-4545-aabc-ff592d03c0e0: rpc.has_security_group_logging(os_id): False [ 1049.305235] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.305478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.305478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.305714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.305779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.306018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.306251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.306357] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.306583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.306711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.306918] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.307034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.307106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.307241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.307323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.307514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.307659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.307659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.307842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.307898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.307946] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1049.372312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.372479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.372528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.372727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.372877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.390902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1049.439549] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3ef768d-b44b-4fc0-82e4-4a82cfa85250 req-b9398f00-ed81-48ab-a088-193fe6caa104 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1049.440079] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1049.440384] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.440508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.440576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.440774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.440931] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.441040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.441105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.441248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.441362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.441446] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.762048] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.762359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.762359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.763033] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.763033] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.763033] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.763251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.763356] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.763496] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.763696] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.763809] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.763918] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.764046] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.764161] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.764272] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.764407] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.784987] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.784987] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.784987] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.784987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.785313] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-2844a724-cd03-45d6-9717-2d86610a1009 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.785487] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.785604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.785928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.786083] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2844a724-cd03-45d6-9717-2d86610a1009',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.859709] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1049.859709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.859709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.859941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.860090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.860210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.860276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.860428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.860510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.860607] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.943827] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.944039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.944111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.944289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.944415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.944615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.944717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.944780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.944937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.945025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.945114] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1049.979284] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.979489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.979489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.979681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.979830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.988652] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1050.289710] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.289710] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.289710] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.289710] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.289710] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.289710] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 2844a724-cd03-45d6-9717-2d86610a1009 not found, creating... [ 1050.290031] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.290211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.290349] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.290622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.290804] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.291124] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.291744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.291744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.291744] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.291915] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.292052] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 2844a724-cd03-45d6-9717-2d86610a1009 is going to be created. [ 1050.319280] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.319548] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.319709] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.319951] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.320222] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.320769] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.363443] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.867913] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.041754] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3ef768d-b44b-4fc0-82e4-4a82cfa85250 req-336bb625-dd6a-41a2-a42e-a8fe216a484f service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 1051.041981] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3ef768d-b44b-4fc0-82e4-4a82cfa85250 req-336bb625-dd6a-41a2-a42e-a8fe216a484f service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1051.042141] env[65319]: INFO networking_nsxv3.common.synchronization [req-a3ef768d-b44b-4fc0-82e4-4a82cfa85250 req-336bb625-dd6a-41a2-a42e-a8fe216a484f service nova] Enqueued Resource ID: 2844a724-cd03-45d6-9717-2d86610a1009 with Priority: HIGHEST for action port [ 1051.042690] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 1051.042829] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1051.042926] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2844a724-cd03-45d6-9717-2d86610a1009 with Priority: HIGHEST for action port [ 1051.043254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.043383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.043462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.043630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.043712] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.044604] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.044761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.045518] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2844a724-cd03-45d6-9717-2d86610a1009 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.045518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.045518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.045518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.045518] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2844a724-cd03-45d6-9717-2d86610a1009',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.369981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.370185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.370382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.370548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.370733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.370796] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1051.401919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.402202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.402202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.402556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.402784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.411242] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1051.411511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.412357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1051.548108] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.548932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.548932] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2844a724-cd03-45d6-9717-2d86610a1009 with status ACTIVE [ 1051.548932] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.548932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.548932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.549192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.549192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.549354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.549354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.549440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.549627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.549729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.549967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.550104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.550188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.550510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.550510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.550617] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2844a724-cd03-45d6-9717-2d86610a1009 is going to be updated. [ 1051.573997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.574272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.574272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.574492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.574637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.574815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2844a724-cd03-45d6-9717-2d86610a1009" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.004023] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1052.004023] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa deletion is rescheduled due to dependency. [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.004023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.004023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.004023] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.248597] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.248853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.248984] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.249350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.249657] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.249829] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.249963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.250186] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.251030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.251030] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.251030] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.251030] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.251030] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.251030] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.251309] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.251309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.275527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.275758] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.275878] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.276018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-482" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.276545] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.276748] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.276872] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.277231] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.277405] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.506625] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.780130] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.780289] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.780416] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.780781] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.780937] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.781247] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.781696] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.781847] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.782084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.782225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.782521] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.782678] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.782818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.783056] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.783211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.783365] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e is going to be updated. [ 1052.828045] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.828691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.828691] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.828927] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.829125] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.829395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.010075] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.425184] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1053.425396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.425551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.426287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.426287] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.426287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.426287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.426580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.426580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.426580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.427142] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.512747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.512914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.513011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.513351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.513465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.513844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1053.547482] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.547650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.547706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.547921] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.548084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.564673] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1053.573293] env[65319]: INFO networking_nsxv3.common.synchronization [req-684ce0b3-8a76-46ce-b212-a8f250bc089b req-1bd3efac-b042-4c82-81aa-b1b9dc96afe7 service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 1053.573589] env[65319]: INFO networking_nsxv3.common.synchronization [req-684ce0b3-8a76-46ce-b212-a8f250bc089b req-1bd3efac-b042-4c82-81aa-b1b9dc96afe7 service nova] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 1053.573589] env[65319]: INFO networking_nsxv3.common.synchronization [req-684ce0b3-8a76-46ce-b212-a8f250bc089b req-1bd3efac-b042-4c82-81aa-b1b9dc96afe7 service nova] Enqueued Resource ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with Priority: HIGHEST for action port [ 1053.574348] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_rules [ 1053.574509] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 1053.574738] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with Priority: HIGHEST for action port [ 1053.574953] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.575110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.575146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.575344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.575466] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.579851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.579851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.579851] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.579851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.579851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.580347] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.929873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.930071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.930182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.930336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.930506] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.930609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.930673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.930890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.930979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.931081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.931230] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.931323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.931384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.931524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.931663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.931791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.931847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.931945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.932083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.932495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.932495] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.083499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.083864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.083864] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.084902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e with status ACTIVE [ 1054.085110] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.085228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.085293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.085507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.085644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.085869] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.086211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.086211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.086211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.086349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.086573] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.086670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.086742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.086904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.086991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.087074] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e is going to be updated. [ 1054.111623] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.111869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.111869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.112118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.112203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.112348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4f0b45-cc3d-4ea1-bae2-6c194c55ed5e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.435575] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1054.553599] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.553845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.553845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.554053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.554149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.554378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.554504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.554896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.554896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.554896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.555096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.555096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.555190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.555290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.555371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.555570] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.555690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.555741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.555861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.555938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.556049] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1054.589099] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.644311] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.644524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.644576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.644779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.644933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.665296] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1055.092730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.093914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.093914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.093914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.093914] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.093914] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 1055.125223] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.125427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.125477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.125757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.125930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.135867] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 1055.576739] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1055.576942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.577213] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.577329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.577538] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.577717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.577807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.577984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.578082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.578172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.578265] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.875566] env[65319]: INFO networking_nsxv3.common.synchronization [req-20e75bc9-d427-4335-afca-c83054550b33 req-d7c115ab-2473-48a4-8e4d-a73c3cddc91d tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1055.875738] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1055.876066] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.876195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.876264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.876511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.876860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.876860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.876860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.877038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.877195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.877309] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.084096] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.381210] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.381497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.381497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.381751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.381910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.382161] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.382274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.382383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.382770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.382770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.382770] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1056.427200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.427200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.427200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.427371] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.427483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.437818] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1056.591328] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa: rpc.has_security_group_logging(os_id): False [ 1056.610260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.610376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.610448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.610678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.610827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.611113] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.611224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.611291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.611461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.611543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.611793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1056.682963] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.683301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.683405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.683744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.683994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.686601] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1056.686872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.698846] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1057.145966] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 1057.146136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.146302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.146560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.146797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.146926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.146993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.147174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.147261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.147345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.147435] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.650052] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.650528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.650528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.650528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.650704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.650806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.650868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.651039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.651119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.651209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.651360] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.651455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.651517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.651662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.651828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.651971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.652048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.652147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.652227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.652309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.652395] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.154224] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57b692c1-c9a8-4318-94f5-2184ff1f58ef: rpc.has_security_group_logging(os_id): False [ 1058.176019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.176225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.176272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.176696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.176825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.177111] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.177227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.177227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.177409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.177514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.177748] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.177931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.177931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.178135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.178135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.178622] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.178622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.178622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.178622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.178804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.178804] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 1058.279824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.279985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.280081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.280305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.280471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.298603] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 1058.453433] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1058.453433] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1058.453694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.719048] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1058.719048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.309766] env[65319]: INFO networking_nsxv3.common.synchronization [req-f2a9dcf9-0ed3-49af-b243-f1d321aa62ac req-f2201df8-180e-4e91-bd93-3527d98e1081 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1059.309766] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1059.310440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.310669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.310669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.310926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.311157] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.311614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.311614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.311889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.312155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.312155] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.816773] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.315364] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 1060.315616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.319115] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.643854] env[65319]: INFO networking_nsxv3.common.synchronization [req-8dbc7403-f9cb-4296-8614-c9ae2065eeca req-9f207b23-e556-4c5f-a9a5-b8e256db78b9 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1060.644818] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1060.646459] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.646931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.646931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.647071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.647275] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.647334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.647427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.647607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.648032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.648186] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.822076] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.822076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.822076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.824040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.824220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.824314] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1060.870977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.871284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.871284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.871462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.871629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.884352] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1060.991810] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.992022] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.992152] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.992429] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.992692] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.993078] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.993078] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.993378] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.993537] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.993751] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.993870] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.993977] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.994105] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.994237] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.994306] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.994441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.014847] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.015134] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.015229] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.015441] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.015877] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-1f0e4951-9c11-4fdc-aee7-65282c3d647c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.016092] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.016225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.016708] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.016908] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0e4951-9c11-4fdc-aee7-65282c3d647c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.152090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.152382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.152382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.152635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.152892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.153238] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.153358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.153452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.153756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.153937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.154147] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1061.188046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.188443] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.188546] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.188908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.189103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.202419] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1061.520535] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.520922] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.521055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.521457] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.521613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.521769] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 1f0e4951-9c11-4fdc-aee7-65282c3d647c not found, creating... [ 1061.522133] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.522344] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.522441] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.522715] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.522891] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.523345] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.523714] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.523894] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.524227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.524375] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.524554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 1f0e4951-9c11-4fdc-aee7-65282c3d647c is going to be created. [ 1061.549075] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.549075] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.549075] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.549487] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.549614] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.549880] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.764720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.764720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.764720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.765046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.765046] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.268206] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.304308] env[65319]: INFO networking_nsxv3.common.synchronization [req-8dbc7403-f9cb-4296-8614-c9ae2065eeca req-6e97f95e-2d54-4af1-97a0-4cb69f6fff27 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1062.304928] env[65319]: INFO networking_nsxv3.common.synchronization [req-8dbc7403-f9cb-4296-8614-c9ae2065eeca req-6e97f95e-2d54-4af1-97a0-4cb69f6fff27 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1062.304928] env[65319]: INFO networking_nsxv3.common.synchronization [req-8dbc7403-f9cb-4296-8614-c9ae2065eeca req-6e97f95e-2d54-4af1-97a0-4cb69f6fff27 service nova] Enqueued Resource ID: 1f0e4951-9c11-4fdc-aee7-65282c3d647c with Priority: HIGHEST for action port [ 1062.305505] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1062.305682] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1062.305814] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0e4951-9c11-4fdc-aee7-65282c3d647c with Priority: HIGHEST for action port [ 1062.307860] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.307860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.307860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.308164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.308355] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.309410] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.309580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.309896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f0e4951-9c11-4fdc-aee7-65282c3d647c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.310038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.310118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.310355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.310457] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0e4951-9c11-4fdc-aee7-65282c3d647c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.770862] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.811919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.812059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.813829] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f0e4951-9c11-4fdc-aee7-65282c3d647c with status ACTIVE [ 1062.814710] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.814710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.814710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.814710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.814710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.815906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.815906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.815906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.815906] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f0e4951-9c11-4fdc-aee7-65282c3d647c is going to be updated. [ 1062.842272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.842466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.842510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.842757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.842976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.843114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f0e4951-9c11-4fdc-aee7-65282c3d647c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.896249] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1062.896577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.212606] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1063.212875] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1063.213054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.213246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.213472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.213660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.213783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.213848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.214011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.214095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.214189] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.274475] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1063.274967] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1063.717768] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.130760] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.130760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.130760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.131036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.144879] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1064.145832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.147260] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1064.182944] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.183195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.183258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.183487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.196754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.197726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1064.197726] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.197726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1064.224803] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.244592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.244800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.244852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.245032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.246489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.246734] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1064.382902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.383354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.383354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.383524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.384054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.384500] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1064.480734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.480955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.481059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.481295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.482020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.482424] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1064.482575] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ffe73d27-cd4d-4ef2-a753-b8b05d2db48d', '5bd590ec-aafc-4836-92d2-a1ad91f3849f', '57b692c1-c9a8-4318-94f5-2184ff1f58ef', 'a6ff30f1-e83b-4620-bed8-4a797757bf9f', '196d2ce6-1e48-4442-a132-6f23fe6096ff', 'd4334772-46a4-4ed8-9e08-70d20fdec313', '7309368a-6428-4484-9891-a482e0bc1bd4', '6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b', '7c15410b-c953-4795-bf47-b964e640b74b', '78252624-98d5-4868-98b5-8ddc06e222b7', 'd656de1a-0150-4fda-a0db-f5e7f52ff373', '9017d4b0-791a-4ebd-9f2d-0db22fee76c4', '1c9a3208-9f97-4dae-ab4b-0e8e455efe41', 'a10b7b6b-66cd-4787-963f-d00ded9a0b66', '31328668-cad5-4bcc-9c72-54d3bf9877fe', 'b6b09724-e475-4a72-9a9a-5f9d496d4627', 'b31e5352-a147-470a-ab00-4f2c60273287', '3b3ae0b8-2b6a-4047-910f-6c73004e35ad', 'a49a2be0-948f-4d73-a2fe-ec8e39d28abc', 'b4d9e57b-7b71-46dd-8bbf-e08a483c33e6', 'e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7', 'bdec9d4c-9475-4260-8af9-fba7e4820934', 'a0a6c793-0760-435d-be82-33d755948f79', '21b6477e-560e-44cf-bf38-d612f918ff7e', '7a8cfb58-c5d8-4371-a4d8-cce23cb883e5', '848d35f9-8739-4545-aabc-ff592d03c0e0', '08b741bf-ee28-4b27-bf6a-78bf52eb3be6', 'a329f993-c39f-4fa0-aa69-6368abd88e7b', '53a1e5a3-4b59-400c-b2d3-35a9514b015c', '0f47eb94-bdf5-494d-a378-78951389d1ea', 'dadc0194-ac9d-406b-a9c6-ec6492e3d268', '746f1312-5d40-4fc8-b702-cb8a17f5faa8', '647501a8-60c2-4fb9-8e6d-3340ae1b9ac1', '6058afe7-0c04-438a-8ff7-fa0b65021981', 'd51d74c1-0bc9-4f08-9e69-0f36720ce33b', '73bd0d96-c37a-417f-a9ec-9f3f59a6889c', '168faf57-13be-4d1b-8a5c-4618e12dde52', '7803898b-69e4-4d33-860f-8dbb01043ade', '658fe8b2-be4c-42fb-841e-f105abeb65cc', '5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0', '282f1cfb-aa79-42a6-936b-877f8ae71035', 'e04b5099-c245-45bb-ba03-28eba19d17c1', '23e179a6-db4e-4e51-ab65-7ae45a30f94e', 'f0e2a77d-4c21-497a-85f5-76d08cf9878e', '2fb71eb3-0fda-4e33-ae51-390153750f63', '64c67b2e-cc70-45f4-b07c-aa5250deaa33', 'b95d83bf-87be-46fb-a121-6221d6adfa83', '2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa', 'a1c365c2-b0da-43cf-8088-9c38fa4c5ec9', 'fd0a2e0b-8eec-4c51-b1ed-6efc9f219567', '1e81f5f5-3357-4ba5-96ae-679bd5c9617f'} {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.482731] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1064.512288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.512639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.512639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.512828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.512828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.512961] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1064.513067] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.513159] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1064.603292] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.603292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.603652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.605570] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.605570] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1064.605570] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.605570] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1064.605749] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1064.605749] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1064.605842] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGH for action security_group_rules [ 1064.605940] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGH for action security_group_rules [ 1064.606016] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGH for action security_group_rules [ 1064.606080] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGH for action security_group_rules [ 1064.606148] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGH for action security_group_rules [ 1064.606222] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGH for action security_group_rules [ 1064.606258] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGH for action security_group_rules [ 1064.606318] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGH for action security_group_rules [ 1064.606391] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGH for action security_group_rules [ 1064.606454] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGH for action security_group_rules [ 1064.606563] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGH for action security_group_rules [ 1064.606615] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGH for action security_group_rules [ 1064.606770] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGH for action security_group_rules [ 1064.606888] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGH for action security_group_rules [ 1064.606959] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGH for action security_group_rules [ 1064.607033] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGH for action security_group_rules [ 1064.607111] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGH for action security_group_rules [ 1064.607176] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGH for action security_group_rules [ 1064.607260] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGH for action security_group_rules [ 1064.607324] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGH for action security_group_rules [ 1064.607440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.728107] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.728315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.728315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.728556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.728638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.728744] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1064.762096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.762262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.762330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.762542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.762693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.773204] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1064.975780] env[65319]: INFO networking_nsxv3.common.synchronization [req-3d34d546-3d0b-4b76-b718-2dc409589967 req-cb3897dc-cccb-456a-81d5-6c2ea90c7f05 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1064.976453] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1064.976884] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d with Priority: HIGH for action security_group_rules [ 1064.976884] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGH for action security_group_rules [ 1064.976884] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7309368a-6428-4484-9891-a482e0bc1bd4 with Priority: HIGH for action security_group_rules [ 1064.977097] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe with Priority: HIGH for action security_group_rules [ 1064.977097] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 with Priority: HIGH for action security_group_rules [ 1064.977270] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc with Priority: HIGH for action security_group_rules [ 1064.977488] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad with Priority: HIGH for action security_group_rules [ 1064.977868] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31e5352-a147-470a-ab00-4f2c60273287 with Priority: HIGH for action security_group_rules [ 1064.977868] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 with Priority: HIGH for action security_group_rules [ 1064.977868] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGH for action security_group_rules [ 1064.977868] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGH for action security_group_rules [ 1064.978073] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGH for action security_group_rules [ 1064.978073] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 with Priority: HIGH for action security_group_rules [ 1064.978298] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78252624-98d5-4868-98b5-8ddc06e222b7 with Priority: HIGH for action security_group_rules [ 1064.978298] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c15410b-c953-4795-bf47-b964e640b74b with Priority: HIGH for action security_group_rules [ 1064.978298] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4334772-46a4-4ed8-9e08-70d20fdec313 with Priority: HIGH for action security_group_rules [ 1064.978407] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b with Priority: HIGH for action security_group_rules [ 1064.978444] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff with Priority: HIGH for action security_group_rules [ 1064.978607] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGH for action security_group_rules [ 1064.978669] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f with Priority: HIGH for action security_group_rules [ 1064.979012] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.979189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.979255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.979567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.979723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.979825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.979888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.980080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.980235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.980337] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.981763] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.981831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.981904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.982181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.982267] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffe73d27-cd4d-4ef2-a753-b8b05d2db48d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.983242] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.983440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.983440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.983594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.983686] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.984590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7309368a-6428-4484-9891-a482e0bc1bd4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.984728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.984802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.985098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.985098] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7309368a-6428-4484-9891-a482e0bc1bd4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.985977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31328668-cad5-4bcc-9c72-54d3bf9877fe taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.986110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.986196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.986544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.986623] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31328668-cad5-4bcc-9c72-54d3bf9877fe',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.988624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.988624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.988624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.988624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.988624] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d9e57b-7b71-46dd-8bbf-e08a483c33e6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.989016] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.989138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.989178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.989302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.989376] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49a2be0-948f-4d73-a2fe-ec8e39d28abc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.990221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.990221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.990436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.990477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.990543] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b3ae0b8-2b6a-4047-910f-6c73004e35ad',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.991275] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31e5352-a147-470a-ab00-4f2c60273287 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.991411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.991477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.991653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.991699] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31e5352-a147-470a-ab00-4f2c60273287',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.992580] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.992580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.992746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.992789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.992843] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a10b7b6b-66cd-4787-963f-d00ded9a0b66',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.996761] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.996906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.996970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.997152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.997231] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.997974] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.999298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.000528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.001132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.001132] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.001556] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.001734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.001734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.001881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.001954] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.003715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d656de1a-0150-4fda-a0db-f5e7f52ff373 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.005119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.005119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.005119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.005644] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d656de1a-0150-4fda-a0db-f5e7f52ff373',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.006453] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78252624-98d5-4868-98b5-8ddc06e222b7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.006609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.006788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.006975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007067] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78252624-98d5-4868-98b5-8ddc06e222b7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.008797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c15410b-c953-4795-bf47-b964e640b74b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.008797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.008797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.008797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.008797] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c15410b-c953-4795-bf47-b964e640b74b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.010859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4334772-46a4-4ed8-9e08-70d20fdec313 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.011451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.011781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.012203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.012482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4334772-46a4-4ed8-9e08-70d20fdec313',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.013757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.014105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.014341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.014708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.014977] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.017640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-196d2ce6-1e48-4442-a132-6f23fe6096ff taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.017640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.017640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.017640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.017640] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('196d2ce6-1e48-4442-a132-6f23fe6096ff',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.018547] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.018881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.019131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.020290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.020290] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.021749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.021749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.021749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.021749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.021749] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ff30f1-e83b-4620-bed8-4a797757bf9f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.021749] env[65319]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1065.036367] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.069701] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.069955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.070138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.070386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.073522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.073606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.075312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.075509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.081745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.081884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.092942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.093089] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7309368a-6428-4484-9891-a482e0bc1bd4 is going to be deleted. [ 1065.094062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.094278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.115220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.115362] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffe73d27-cd4d-4ef2-a753-b8b05d2db48d is going to be deleted. [ 1065.116482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.116615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.141565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.141709] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b3ae0b8-2b6a-4047-910f-6c73004e35ad is going to be deleted. [ 1065.142726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.144349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.163035] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.163201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.165563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.165723] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49a2be0-948f-4d73-a2fe-ec8e39d28abc is going to be deleted. [ 1065.166883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.167077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.167169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.167315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7309368a-6428-4484-9891-a482e0bc1bd4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.187807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.187807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.187807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.187807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.188241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.188241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffe73d27-cd4d-4ef2-a753-b8b05d2db48d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.210089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.210325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.210325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.210561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.210650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.210764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b3ae0b8-2b6a-4047-910f-6c73004e35ad" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.236209] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.236430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.236430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.236880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.236993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.237135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49a2be0-948f-4d73-a2fe-ec8e39d28abc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.386461] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.386892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.386959] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.387506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.387877] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.388071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.388196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.388491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.388679] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.388907] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.389032] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.389143] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.389249] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.389359] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.389464] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.389613] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.413817] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.414024] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.414191] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.414389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-635" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.414741] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-f46c28b0-de87-425f-a68a-ef844483a3e2 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.414939] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.415090] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.415430] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.415575] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f46c28b0-de87-425f-a68a-ef844483a3e2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.536080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.536080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.536080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.536080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.536080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.536695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.536695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.536695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.536695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.536695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.536695] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.539135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.539345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.539345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.539554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.539660] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.539854] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.541033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.541033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.541033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.541033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.541033] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.541989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.542298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.542298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.542565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.542649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.542754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.542860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.543046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.543114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.543328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.543328] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.548474] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.548883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.548883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.548883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.549178] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.549270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.549307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.549466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.550039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.550039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.550039] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.552393] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.552521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.552633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.552836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.560165] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.560165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.562196] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.597461] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.597461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.598769] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.598982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.601304] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.601583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.602869] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.602869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.603410] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.603533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.604359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.604469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.605798] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.606153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.606985] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.607060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.607824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.608180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.609368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b is going to be deleted. [ 1065.610361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.611037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.617125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.617125] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.633335] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.634133] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d9e57b-7b71-46dd-8bbf-e08a483c33e6 is going to be deleted. [ 1065.634488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.634732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.667633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.667947] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 196d2ce6-1e48-4442-a132-6f23fe6096ff is going to be deleted. [ 1065.670175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.670175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.674805] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.675070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.691879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.692063] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31e5352-a147-470a-ab00-4f2c60273287 is going to be deleted. [ 1065.693549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.693824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.702096] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.702318] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.713142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.713333] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4334772-46a4-4ed8-9e08-70d20fdec313 is going to be deleted. [ 1065.714897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.714986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.737354] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.737624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.744474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.744814] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a10b7b6b-66cd-4787-963f-d00ded9a0b66 is going to be deleted. [ 1065.745662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.745920] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.761288] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.761501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.787884] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.788090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.830366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.830576] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78252624-98d5-4868-98b5-8ddc06e222b7 is going to be deleted. [ 1065.831813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.832099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.886693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.886693] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d656de1a-0150-4fda-a0db-f5e7f52ff373 is going to be deleted. [ 1065.887709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.887951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.893805] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.894028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.918431] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.918754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.918827] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.919139] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.919296] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.919627] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port f46c28b0-de87-425f-a68a-ef844483a3e2 not found, creating... [ 1065.919840] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.920018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.920142] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.920389] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.920531] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.920941] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.921136] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.921255] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.921482] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.921623] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.921769] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: f46c28b0-de87-425f-a68a-ef844483a3e2 is going to be created. [ 1065.933947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.935026] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c15410b-c953-4795-bf47-b964e640b74b is going to be deleted. [ 1065.935370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.935662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.982100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.982314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.992076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.992255] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31328668-cad5-4bcc-9c72-54d3bf9877fe is going to be deleted. [ 1065.993206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.993442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.996188] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.996416] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.996604] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.996983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.997677] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.997677] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.056414] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.059043] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.060442] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.060609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.061039] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.062549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.062983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be deleted. [ 1066.064139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.064470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.066369] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.066529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.066628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.067368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.067368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.067368] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be updated. [ 1066.069418] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.069418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.069418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.069418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.069726] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.069726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.069726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.069918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.069918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.069918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.070098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.070175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.070244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.070380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.070488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.070586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.070647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.071060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.071060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.071060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.071060] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.113785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113785] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ff30f1-e83b-4620-bed8-4a797757bf9f is going to be deleted. [ 1066.115289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.115534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.115630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.115764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab3efcc-55ca-4643-9d35-89eb2d4cdf0b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.115927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.116102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.116185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.116647] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d9e57b-7b71-46dd-8bbf-e08a483c33e6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.116924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.117112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.117197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.117321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-196d2ce6-1e48-4442-a132-6f23fe6096ff" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.117449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.117593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.117732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.117866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31e5352-a147-470a-ab00-4f2c60273287" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.117993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.118153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.118228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4334772-46a4-4ed8-9e08-70d20fdec313" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.118599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.118674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a10b7b6b-66cd-4787-963f-d00ded9a0b66" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.119091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.119182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.119294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78252624-98d5-4868-98b5-8ddc06e222b7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.119416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.119559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.119633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.119738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d656de1a-0150-4fda-a0db-f5e7f52ff373" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.150904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.151121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.151121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.151321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.151414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.151594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c15410b-c953-4795-bf47-b964e640b74b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.168600] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.168830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.168882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.169214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.169451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.172572] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.172794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.172794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.173086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.173257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.173503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31328668-cad5-4bcc-9c72-54d3bf9877fe" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.192896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 1066.250951] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.251119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.251214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.251462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.251616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.251740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.280781] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.281476] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.281747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.281829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.282044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.282150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.282311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ff30f1-e83b-4620-bed8-4a797757bf9f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.559647] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9a3208-9f97-4dae-ab4b-0e8e455efe41: rpc.has_security_group_logging(os_id): False [ 1066.562385] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9017d4b0-791a-4ebd-9f2d-0db22fee76c4: rpc.has_security_group_logging(os_id): False [ 1066.565823] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6b09724-e475-4a72-9a9a-5f9d496d4627: rpc.has_security_group_logging(os_id): False [ 1066.573555] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57b692c1-c9a8-4318-94f5-2184ff1f58ef: rpc.has_security_group_logging(os_id): False [ 1066.578745] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.578931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.578976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.579273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.581392] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.581548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.590216] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.590363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.591145] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.591288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.601459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.601938] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.602071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.602180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.602342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.602427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.602535] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 is going to be updated. [ 1066.603778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.603778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.621930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.622262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.622367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.622728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.622845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.622929] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 is going to be updated. [ 1066.624576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.624799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.651749] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.652059] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.652187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.652253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.652564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.652564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.652736] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.652834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.652958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.653426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.653426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.653426] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.653602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.653602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.653682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.653722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.653775] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 1066.654878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.655046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.660224] env[65319]: INFO networking_nsxv3.common.synchronization [req-3d34d546-3d0b-4b76-b718-2dc409589967 req-835bb158-28fc-4fb5-9cba-c19071fa05c3 service nova] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 1066.660388] env[65319]: INFO networking_nsxv3.common.synchronization [req-3d34d546-3d0b-4b76-b718-2dc409589967 req-835bb158-28fc-4fb5-9cba-c19071fa05c3 service nova] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1066.660428] env[65319]: INFO networking_nsxv3.common.synchronization [req-3d34d546-3d0b-4b76-b718-2dc409589967 req-835bb158-28fc-4fb5-9cba-c19071fa05c3 service nova] Enqueued Resource ID: f46c28b0-de87-425f-a68a-ef844483a3e2 with Priority: HIGHEST for action port [ 1066.660885] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_rules [ 1066.660885] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1066.660885] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c28b0-de87-425f-a68a-ef844483a3e2 with Priority: HIGHEST for action port [ 1066.662080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.662212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.662282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.662477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.662559] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.663543] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.664028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.664028] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-f46c28b0-de87-425f-a68a-ef844483a3e2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.664028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.664215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.664255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.664342] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f46c28b0-de87-425f-a68a-ef844483a3e2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.678880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.679169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.679296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.679353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.679554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.679635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.679723] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 is going to be updated. [ 1066.682449] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.682580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.682629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.682798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.682931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.692698] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.692884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.692884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.693080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.693217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.701939] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: IN_PROGRESS for 2s [ 1066.702445] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: IN_PROGRESS for 2s [ 1066.745170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.745271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.745340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.745544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.745690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.782974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 1066.784080] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.784238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.784305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.784528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.784758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792509] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1066.792727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.792897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.793940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.794049] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.820350] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: IN_PROGRESS for 2s [ 1067.166138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.166315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.166543] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f46c28b0-de87-425f-a68a-ef844483a3e2 with status ACTIVE [ 1067.166780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.166941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.166989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.167188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.167277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.167450] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.167542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.167603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.167772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.167866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.168142] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.168535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.168535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.168535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.168535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.168535] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f46c28b0-de87-425f-a68a-ef844483a3e2 is going to be updated. [ 1067.189404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.189404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.189610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.189726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.189867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.190060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f46c28b0-de87-425f-a68a-ef844483a3e2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.296939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.297228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.297228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.297475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.297566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.297696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.297808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.298021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.298136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.298222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.298350] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.298468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.298554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.298652] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.298770] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.298867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.299059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.299059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.299206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.299206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.299343] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.801043] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95d83bf-87be-46fb-a121-6221d6adfa83: rpc.has_security_group_logging(os_id): False [ 1067.825513] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.825845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.826111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.826609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.848787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.849272] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.849492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.849632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.850062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.850062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.851097] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.851097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.851097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.851097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.851097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.851372] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.851372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.851483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.851834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.851834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.851921] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1067.920137] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.920291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.920366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.920653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.920717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.938674] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1068.208247] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.208247] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.208247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.208247] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.710903] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.718508] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: SUCCESS [ 1068.718751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.719941] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: SUCCESS [ 1068.720315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.800380] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 1068.800380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.841330] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: SUCCESS [ 1068.841767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.213049] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.715557] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.715750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.715967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.716031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.716093] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.716182] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be updated. [ 1069.749777] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.749938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.750023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.750606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.750606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.760940] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 1069.954028] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1069.954028] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.662227] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1071.662704] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1071.720262] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c8a3da4-84a5-46ff-810a-f40a87171092 req-19cb109a-91a4-42f9-8c31-534a5a62b55e tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1071.720858] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1071.721190] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.721303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.721425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.721567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.721725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.721825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.721886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.722173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.722173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.722301] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.773072] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 1071.773314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.773488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.773732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.773937] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.774114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.774240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.774341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.774762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.774762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.774762] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.030698] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.030957] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.031120] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.031421] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.032125] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.032326] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.032475] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.032722] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.032907] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.033165] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.033301] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.033437] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.033576] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.033706] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.033847] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.034009] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.055548] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.055685] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.055773] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.056027] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.056378] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.056505] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.056619] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.057059] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.057212] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b59d26-96fb-4574-94ae-e5b78fc4bd8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.226049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.226049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.226049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.226049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.226049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.226049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.226049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.226584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.226584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.226584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.226584] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be deleted. [ 1072.259615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.259839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.259839] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.260176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.260263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.260405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.277076] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.560458] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.560690] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.560823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.561134] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.561397] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.561568] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port c4b59d26-96fb-4574-94ae-e5b78fc4bd8a not found, creating... [ 1072.561973] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.562206] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.562289] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.562527] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.562671] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.563266] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.563266] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.563483] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.563542] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.563655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.563794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: c4b59d26-96fb-4574-94ae-e5b78fc4bd8a is going to be created. [ 1072.586509] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.586756] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.586949] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.587363] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.587463] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.587687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.782225] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 658fe8b2-be4c-42fb-841e-f105abeb65cc: rpc.has_security_group_logging(os_id): False [ 1072.805961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.806266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.806266] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.806850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.831219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.831570] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.831700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.831761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.831968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.832067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.832149] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be updated. [ 1072.895984] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.896143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.896214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.896427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.896588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.910840] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 1073.223031] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7f4ad23-cf87-4e35-a46c-4d365d198626 req-a2c75cd8-ab61-4267-99f5-afaf6fb3fc3a tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1073.223576] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1073.224058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.224217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.224311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.224600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.224823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.224952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.225058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.225306] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.225669] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.225669] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.313575] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c8a3da4-84a5-46ff-810a-f40a87171092 req-238df0fc-c2f2-4943-8bad-d7bd44d0eb50 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1073.313633] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c8a3da4-84a5-46ff-810a-f40a87171092 req-238df0fc-c2f2-4943-8bad-d7bd44d0eb50 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1073.313905] env[65319]: INFO networking_nsxv3.common.synchronization [req-5c8a3da4-84a5-46ff-810a-f40a87171092 req-238df0fc-c2f2-4943-8bad-d7bd44d0eb50 service nova] Enqueued Resource ID: c4b59d26-96fb-4574-94ae-e5b78fc4bd8a with Priority: HIGHEST for action port [ 1073.314451] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1073.314911] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1073.314911] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4b59d26-96fb-4574-94ae-e5b78fc4bd8a with Priority: HIGHEST for action port [ 1073.315261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.315434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.315507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.315833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.315929] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.318590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.318590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.318590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.319173] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.320205] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.320423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.320491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.320798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.320858] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b59d26-96fb-4574-94ae-e5b78fc4bd8a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.622478] env[65319]: INFO networking_nsxv3.common.synchronization [req-0d23be56-cb82-449a-a410-12a742632095 req-914fb8f6-f70d-468f-b9ec-d154bd1f7061 tempest-ServersTestBootFromVolume-1104516695 tempest-ServersTestBootFromVolume-1104516695-project-member] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1073.623102] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGHEST for action security_group_members [ 1073.623449] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.623611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.623691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.623900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.624090] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.624178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.624219] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.624398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.624485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.624579] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.660090] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.660346] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.660461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.660707] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.660976] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.661169] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.661323] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.661571] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.661738] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.661956] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.662140] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.662331] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.662505] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.662678] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.662818] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.662963] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.684572] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.684785] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.684982] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.685223] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.685544] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-759469a5-b387-4647-a81f-139d0dd058ab taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.685719] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.685838] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.686193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.686333] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759469a5-b387-4647-a81f-139d0dd058ab',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.728400] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.823191] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.823538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.823760] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.824775] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4b59d26-96fb-4574-94ae-e5b78fc4bd8a with status ACTIVE [ 1073.824989] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.825167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.825228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.825454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.825549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.825737] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.825870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.825928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.826055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.826138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.826321] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.826451] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.826555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.826620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.826720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.826789] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4b59d26-96fb-4574-94ae-e5b78fc4bd8a is going to be updated. [ 1073.849936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.850111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.850169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.850379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.850821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.850821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4b59d26-96fb-4574-94ae-e5b78fc4bd8a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.129168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.129366] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.129525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.129852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.151702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.151882] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.152044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.152119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.152324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.152418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.152527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 is going to be updated. [ 1074.180959] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.181180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.181230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.181456] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.181605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.189149] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.189449] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.189640] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.189949] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.190157] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.190323] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 759469a5-b387-4647-a81f-139d0dd058ab not found, creating... [ 1074.190668] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.190862] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.190983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.191243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.191451] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.191900] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.192022] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.192126] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.192350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.192490] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.192630] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 759469a5-b387-4647-a81f-139d0dd058ab is going to be created. [ 1074.195293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: IN_PROGRESS for 2s [ 1074.212148] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.212451] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.212619] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.212892] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.213135] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.213358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.230993] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.329291] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.735361] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.735569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.736265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.736265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.736265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.736265] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1074.772891] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.773181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.773181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.773299] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.773437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.782883] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1074.832478] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.832911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.832911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.833653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.833653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.833653] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be created. [ 1074.861475] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.861740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.861740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.861898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.862097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.871504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: UNINITIALIZED for 2s [ 1074.927176] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 1074.927176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.950794] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7f4ad23-cf87-4e35-a46c-4d365d198626 req-2d1f807d-93d3-40db-98da-0cc71e8aa78f service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1074.950973] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7f4ad23-cf87-4e35-a46c-4d365d198626 req-2d1f807d-93d3-40db-98da-0cc71e8aa78f service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1074.951164] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7f4ad23-cf87-4e35-a46c-4d365d198626 req-2d1f807d-93d3-40db-98da-0cc71e8aa78f service nova] Enqueued Resource ID: 759469a5-b387-4647-a81f-139d0dd058ab with Priority: HIGHEST for action port [ 1074.951805] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1074.951944] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1074.952055] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759469a5-b387-4647-a81f-139d0dd058ab with Priority: HIGHEST for action port [ 1074.952341] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.952446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.952514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.952728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.952864] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.953695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.953795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.953987] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-759469a5-b387-4647-a81f-139d0dd058ab taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.954103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.954167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.954330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.954430] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759469a5-b387-4647-a81f-139d0dd058ab',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.457927] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.458248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.458486] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759469a5-b387-4647-a81f-139d0dd058ab with status ACTIVE [ 1075.458690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.458860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.458980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.459545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.459545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.459772] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.459913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.459983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.460220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.460365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.460555] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.460646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.460713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.460996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.461086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.461199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759469a5-b387-4647-a81f-139d0dd058ab is going to be updated. [ 1075.485064] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.485284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.485336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.485595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.485740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.485941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759469a5-b387-4647-a81f-139d0dd058ab" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.207540] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 in Status: SUCCESS [ 1076.207910] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 deletion is rescheduled due to dependency. [ 1076.207910] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.792838] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1076.793103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.793241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.793463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.793658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.793777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.793843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.793988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.794083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.794180] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.884176] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1076.884490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.884708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.884992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.885258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.885413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.885503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.885710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.885816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.885930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.886066] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.296435] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.388553] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.388759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.388759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.388988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.389179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.389286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.389361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.389520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.389605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.389689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.389833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.389924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.389984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.390162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.390303] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.390393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.390452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.390588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.390661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.390742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.390830] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.799921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.893186] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd590ec-aafc-4836-92d2-a1ad91f3849f: rpc.has_security_group_logging(os_id): False [ 1077.914566] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.914566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.914566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.914758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.914758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.914907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.915059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.915132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.915315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.915578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.915706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.915923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.915923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.916030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.916066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.916280] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.916382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.916433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.916565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.916638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.916724] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be created. [ 1077.982724] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.982947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.983010] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.983375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.983631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.997291] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1078.301822] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.302169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.302169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.302361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.302464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.302576] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1078.336621] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.336859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.336859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.337106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.337286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.346847] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1078.949272] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d080f22e-ee8e-47ad-9752-07695bcd2581 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1078.949459] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1078.949819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.949946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.950012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.953105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.954534] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.954664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.954735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.954942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.955072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.955182] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.457812] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.962583] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.013993] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1080.014424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.359282] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1080.359605] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.360531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.360813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.361058] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.361192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.361258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.361432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.361515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.361603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.361698] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.464533] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.464989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.464989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.464989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.465185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.465225] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1080.503720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.503720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.503720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.503720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.503720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.523184] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1080.865024] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.865246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.865246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.865481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.865638] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.865741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.865807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.865958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.866057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.866148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.866295] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.866385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.866445] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.866587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.866725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.866814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.866875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.867070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.867203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.867324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.867443] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.370326] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1081.391268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.391515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.391594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.391810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.413358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.413680] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.413802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.413870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.414158] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.414281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.414520] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.414664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.414730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.414893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.414966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.415166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.415353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.415353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.415450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.415523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.415611] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1081.479510] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.479878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.479878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.479969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.480126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.497545] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1081.911012] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.911229] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.911358] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.911682] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.911952] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.912123] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.912238] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.912467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.912608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.912814] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.912996] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.913124] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.913233] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.913342] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.913476] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.913639] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.932490] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.932646] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1081.932780] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.932948] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.933270] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.933444] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.933573] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.933874] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.934025] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.437299] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.438032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.438032] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.438359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.438634] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.438892] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 not found, creating... [ 1082.439368] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.439654] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.439863] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.440241] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.440492] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.440956] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.441236] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.441447] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.441777] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.441998] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.442241] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 is going to be created. [ 1082.467782] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.467782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.467782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.467782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.467782] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.468154] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.533178] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1082.533726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.182728] env[65319]: INFO networking_nsxv3.common.synchronization [req-aa50c503-bf60-4090-8f60-d0c2679b50ab req-f0b4b4b4-e3ac-4fef-bf78-b718c1af760c service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1083.182941] env[65319]: INFO networking_nsxv3.common.synchronization [req-aa50c503-bf60-4090-8f60-d0c2679b50ab req-f0b4b4b4-e3ac-4fef-bf78-b718c1af760c service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1083.183140] env[65319]: INFO networking_nsxv3.common.synchronization [req-aa50c503-bf60-4090-8f60-d0c2679b50ab req-f0b4b4b4-e3ac-4fef-bf78-b718c1af760c service nova] Enqueued Resource ID: bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 with Priority: HIGHEST for action port [ 1083.183738] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1083.183877] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1083.183975] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 with Priority: HIGHEST for action port [ 1083.184270] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.184413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.184512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.184744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.184834] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.186742] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.186742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.186742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.186742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.186975] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.186975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.187188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.187293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.187368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.187475] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.189237] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.189406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.189465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.189639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.189728] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.521890] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1083.521890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.687023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.687023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.693035] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.693545] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 with status ACTIVE [ 1083.693653] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.693746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.693798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.694022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.694134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.694379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.694490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.694490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.695170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.695170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.695170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.695170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.695170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.695170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.695661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.695661] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808 is going to be updated. [ 1083.718581] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.718731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.718806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.719602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.719602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.719602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbc95ba2-03ae-46a2-9ff3-2d13b8c2c808" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.197697] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.434710] env[65319]: INFO networking_nsxv3.common.synchronization [req-28be1143-3976-4f46-9ebe-e4bf7b816660 req-5b043c97-429b-4f44-9f35-ffa6afe0e67c tempest-DeleteServersTestJSON-1969761511 tempest-DeleteServersTestJSON-1969761511-project-member] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1084.435403] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGHEST for action security_group_members [ 1084.435757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.436066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.436066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.436403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.439417] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.439694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.439841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.440301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.440301] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.440453] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.700969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.701486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.701486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.701486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.701751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.701751] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1084.732963] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.733183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.733282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.733515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.733720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.744528] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1084.943512] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.943705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.943758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.943980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.966173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.966386] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.966466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.966530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.966740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.966968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.966968] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be updated. [ 1084.995458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.995677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.995677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.995874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.996059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.006017] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: IN_PROGRESS for 2s [ 1086.618957] env[65319]: INFO networking_nsxv3.common.synchronization [req-0c615294-a500-47f4-b22b-b25bbb81905e req-3dfc2b1c-0c6e-436e-93d7-ec631295999a tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1086.619641] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGHEST for action security_group_members [ 1086.619969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.620288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.620395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.620661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.620892] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.621081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.621221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.621662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.621814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.621955] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.756214] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 4s [ 1087.017236] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 in Status: SUCCESS [ 1087.017459] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 deletion is rescheduled due to dependency. [ 1087.017579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.124421] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.125553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.125553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.125553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.125698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.125892] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.126013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.126096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.126273] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.126349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.126433] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 is going to be updated. [ 1087.158689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.158893] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.158990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.159246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.159411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.169565] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: IN_PROGRESS for 2s [ 1088.769018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.773017] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.773017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.773017] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.179574] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 in Status: SUCCESS [ 1089.179743] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 deletion is rescheduled due to dependency. [ 1089.179853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.275967] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.275967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.276096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.276285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.276451] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.276559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.276623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.276777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.276866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.276953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.277118] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.277280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.277474] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.277653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.277817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.277926] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.277992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.278165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.278376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.278496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.278605] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.780269] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd590ec-aafc-4836-92d2-a1ad91f3849f: rpc.has_security_group_logging(os_id): False [ 1089.798296] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.798526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.798575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.798752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.798875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.799065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.799207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.799207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.799364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.799438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.799692] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.799780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.799847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.799988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.800077] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.800261] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.800345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.800411] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.800548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.800620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.800705] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1089.862879] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.863137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.863200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.863469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.863670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.879114] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1091.419385] env[65319]: INFO networking_nsxv3.common.synchronization [req-6b263dea-80a0-4e4f-b1a3-0aba718f33e5 req-a3e55b94-15e2-4ad7-8b29-1749617fbd9b tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1091.420702] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1091.420702] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.420702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.420702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.420917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.421239] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.421393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.421459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.421693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.421744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.421809] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.898095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1091.898436] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.924198] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.924415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.924415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.924645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.924740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.924923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.925067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.925132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.925367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.925462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.925624] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1091.955990] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.955990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.955990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.955990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.955990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.966972] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1093.978229] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1093.978516] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1093.978574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.614151] env[65319]: INFO networking_nsxv3.common.synchronization [req-39623bd1-a239-4f54-abe7-c5a32f9a108c req-20c721b9-a037-4829-91cc-2c955ea340d2 tempest-AttachVolumeTestJSON-2099494044 tempest-AttachVolumeTestJSON-2099494044-project-member] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1094.615458] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGHEST for action security_group_members [ 1094.615458] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.615458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.615458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.615748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.615955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.616048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.616138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.616295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.616382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.616532] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.118796] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.119182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.119261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.119517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.143447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.143447] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.143447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.143648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.143786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.143929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.144046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 is going to be updated. [ 1095.179962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.179962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.179962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.179962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.179962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.194034] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: IN_PROGRESS for 2s [ 1095.288654] env[65319]: INFO networking_nsxv3.common.synchronization [req-bd80c60e-a361-4e44-8aef-8f3c6ea33dfb req-f35c03b8-0cbc-4b92-84d2-8f9c475c7fd3 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1095.289367] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1095.289729] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.289895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.289977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.292402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.292706] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.292903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.293066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.293317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.297031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.297031] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.715989] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.716219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.716353] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.716629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.716895] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.717093] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.717219] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.717503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.717661] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.717880] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.718018] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.718132] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.718240] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.718479] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.718574] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.718713] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.744665] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.744898] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.744985] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.745190] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.745650] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-1ac02a93-fd8b-406e-b673-46480a4fb63e taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.745869] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.745990] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.746348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.746493] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ac02a93-fd8b-406e-b673-46480a4fb63e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.799470] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.249835] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.250269] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.250269] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.250585] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.250749] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.250907] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 1ac02a93-fd8b-406e-b673-46480a4fb63e not found, creating... [ 1096.251194] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.251454] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.251454] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.251684] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.251818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.252125] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.252277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.252391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.252706] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.252841] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.252981] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 1ac02a93-fd8b-406e-b673-46480a4fb63e is going to be created. [ 1096.281223] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.281563] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.285330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.285330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.285330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.285330] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.302879] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.588842] env[65319]: INFO networking_nsxv3.common.synchronization [req-60a37118-bcd1-43c0-b423-ebf918072152 req-9a7cd2ca-fd41-4c2a-9934-97c927920c0a tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1096.589421] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1096.589781] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.589911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.589974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.590333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.590501] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.590628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.590677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.590887] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.590979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.591088] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.805514] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.805666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.805732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.805947] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.806136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.806136] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1096.846408] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.846620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.846620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.846871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.847031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.859757] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1097.022109] env[65319]: INFO networking_nsxv3.common.synchronization [req-bd80c60e-a361-4e44-8aef-8f3c6ea33dfb req-98b62b39-d0e7-478e-aab0-79524515bf75 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1097.022282] env[65319]: INFO networking_nsxv3.common.synchronization [req-bd80c60e-a361-4e44-8aef-8f3c6ea33dfb req-98b62b39-d0e7-478e-aab0-79524515bf75 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1097.022414] env[65319]: INFO networking_nsxv3.common.synchronization [req-bd80c60e-a361-4e44-8aef-8f3c6ea33dfb req-98b62b39-d0e7-478e-aab0-79524515bf75 service nova] Enqueued Resource ID: 1ac02a93-fd8b-406e-b673-46480a4fb63e with Priority: HIGHEST for action port [ 1097.022676] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1097.022799] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1097.022890] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac02a93-fd8b-406e-b673-46480a4fb63e with Priority: HIGHEST for action port [ 1097.024000] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.024000] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.024000] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.024000] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.024000] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.025176] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.025384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.025649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ac02a93-fd8b-406e-b673-46480a4fb63e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.025756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.025819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.025993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.026077] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ac02a93-fd8b-406e-b673-46480a4fb63e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.093132] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.206622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04b5099-c245-45bb-ba03-28eba19d17c1 in Status: SUCCESS [ 1097.206866] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 deletion is rescheduled due to dependency. [ 1097.206989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.526143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.526665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.531333] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ac02a93-fd8b-406e-b673-46480a4fb63e with status ACTIVE [ 1097.531580] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.531737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.531809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.532060] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.532153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.532339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.532444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.532517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.532694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.532775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.532962] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.533087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.533152] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.533309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.533387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.533475] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ac02a93-fd8b-406e-b673-46480a4fb63e is going to be updated. [ 1097.572477] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.572477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.572646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.572778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.572979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.573257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ac02a93-fd8b-406e-b673-46480a4fb63e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.595921] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.701515] env[65319]: INFO networking_nsxv3.common.synchronization [None req-94d79ae1-c21d-4c0b-8f10-6cc7ec72b86e tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1097.702034] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1097.702414] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.702522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.098857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.099035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.099114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.099372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.099428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.099527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1098.135231] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.135231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.135231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.135231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.135231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.144989] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1098.647199] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f2dee6bc-c645-4b10-ad72-45accbfe4bf3 None None] Enqueued Resource ID: c574bc90-dea3-4ec3-8e79-30b2fbf2a992 with Priority: HIGHEST for action port [ 1098.647199] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c574bc90-dea3-4ec3-8e79-30b2fbf2a992 with Priority: HIGHEST for action port [ 1098.647199] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c574bc90-dea3-4ec3-8e79-30b2fbf2a992 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.647199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c574bc90-dea3-4ec3-8e79-30b2fbf2a992" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.647199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c574bc90-dea3-4ec3-8e79-30b2fbf2a992" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.647199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c574bc90-dea3-4ec3-8e79-30b2fbf2a992" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.648244] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c574bc90-dea3-4ec3-8e79-30b2fbf2a992',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.872784] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1098.873161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.873425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.873760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.874071] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.874271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.874428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.874903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.874903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.875230] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.151294] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c574bc90-dea3-4ec3-8e79-30b2fbf2a992 [ 1099.152034] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.152034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.152433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.152433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.152724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.152724] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c574bc90-dea3-4ec3-8e79-30b2fbf2a992 already deleted. [ 1099.152993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c574bc90-dea3-4ec3-8e79-30b2fbf2a992" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.378896] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.883306] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.156127] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1100.156339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.156467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.156859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.156859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.156993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.157061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.157490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.158513] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.158687] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.388901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.390055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.390155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.390380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.390491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.390602] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1100.423121] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.423272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.423344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.423554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.423697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.433712] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1100.622345] env[65319]: INFO networking_nsxv3.common.synchronization [req-a34a1e33-ca0b-44d4-b162-d57e9ec65537 req-e158b0b6-9e4e-4873-86be-2438d1a6d895 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1100.624184] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1100.624488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.624645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.624716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.625549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.625740] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.625855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.625925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.626111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.626201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.626296] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.631678] env[65319]: INFO networking_nsxv3.common.synchronization [req-e771360f-c101-443e-a5e2-95f1350299b0 req-1efea210-dd65-4c29-8479-011770009048 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1100.632067] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGHEST for action security_group_members [ 1100.632747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.632747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.632890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.634440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.634440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.634440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.634440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.634440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.634440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.634440] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.660949] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.661130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.661202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.661413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.665021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.665021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.665021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.665021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.665021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.665021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.665021] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1100.698023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.698023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.698023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.698023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.698023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.707105] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1101.109687] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.109687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.109687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.109687] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.111102] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.111271] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.111402] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.111712] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.111860] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.112110] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.112238] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.112365] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.112450] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.112739] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.112880] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.113082] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.129075] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.129350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.129350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.129519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.129646] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.129909] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.130088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.130444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.130608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.130911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.131108] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1101.135775] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.135951] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.137030] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.137030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.137030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-fde72793-519e-47a5-8562-b0a950d1fd4c taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.137030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.137030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.137318] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.137318] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fde72793-519e-47a5-8562-b0a950d1fd4c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.141046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.141699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.141699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.141699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.141699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.142133] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.142133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.142133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.142488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.142488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.142698] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 is going to be updated. [ 1101.162550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.162699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.162911] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.163041] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.163198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.175936] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1101.177909] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.178051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.178943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.178943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.178943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.187770] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: IN_PROGRESS for 2s [ 1101.630284] env[65319]: INFO networking_nsxv3.common.synchronization [None req-03b100ac-7659-403c-aae2-0e53d88126ab None None] Enqueued Resource ID: ba0161f9-18bd-498e-b9ce-30bfcd31db87 with Priority: HIGHEST for action port [ 1101.630873] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0161f9-18bd-498e-b9ce-30bfcd31db87 with Priority: HIGHEST for action port [ 1101.631206] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0161f9-18bd-498e-b9ce-30bfcd31db87 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.631364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0161f9-18bd-498e-b9ce-30bfcd31db87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.631453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0161f9-18bd-498e-b9ce-30bfcd31db87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.631790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0161f9-18bd-498e-b9ce-30bfcd31db87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.631884] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0161f9-18bd-498e-b9ce-30bfcd31db87',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.641550] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.641763] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.641888] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.642187] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.642348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.642854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port fde72793-519e-47a5-8562-b0a950d1fd4c not found, creating... [ 1101.643169] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.643356] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.643487] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.643754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.643909] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.644224] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.644768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.644768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.644768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.644890] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.644992] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: fde72793-519e-47a5-8562-b0a950d1fd4c is going to be created. [ 1101.671223] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.672794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.672794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.672794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.672794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.672794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.135485] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba0161f9-18bd-498e-b9ce-30bfcd31db87 [ 1102.136473] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.136699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.136780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.137025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.137592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.137592] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba0161f9-18bd-498e-b9ce-30bfcd31db87 already deleted. [ 1102.137592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0161f9-18bd-498e-b9ce-30bfcd31db87" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.411824] env[65319]: INFO networking_nsxv3.common.synchronization [req-41f5c00c-9b72-4a8c-91cc-8bfe0381cb18 req-f2f75498-01b5-4418-b7f5-33b42447df7f tempest-ServersNegativeTestJSON-1277425665 tempest-ServersNegativeTestJSON-1277425665-project-member] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 1102.412708] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGHEST for action security_group_members [ 1102.413853] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.414085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.414251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.414367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.414538] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.414636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.414704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.414853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.414939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.415041] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.458319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1102.458677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.458952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.459216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.459715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.459715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.459715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.460655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.460655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.460655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.460655] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.465220] env[65319]: INFO networking_nsxv3.common.synchronization [req-a34a1e33-ca0b-44d4-b162-d57e9ec65537 req-b8840d59-61b9-4501-a3df-104afd8d564f service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1102.465707] env[65319]: INFO networking_nsxv3.common.synchronization [req-a34a1e33-ca0b-44d4-b162-d57e9ec65537 req-b8840d59-61b9-4501-a3df-104afd8d564f service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1102.465964] env[65319]: INFO networking_nsxv3.common.synchronization [req-a34a1e33-ca0b-44d4-b162-d57e9ec65537 req-b8840d59-61b9-4501-a3df-104afd8d564f service nova] Enqueued Resource ID: fde72793-519e-47a5-8562-b0a950d1fd4c with Priority: HIGHEST for action port [ 1102.466647] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1102.466916] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1102.467095] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fde72793-519e-47a5-8562-b0a950d1fd4c with Priority: HIGHEST for action port [ 1102.467471] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.467684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.467808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.468115] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.468330] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.469294] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.469446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.469693] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-fde72793-519e-47a5-8562-b0a950d1fd4c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.469864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.469981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.470247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.470359] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fde72793-519e-47a5-8562-b0a950d1fd4c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.718801] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1102.718996] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f deletion is rescheduled due to dependency. [ 1102.719136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.920369] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.920626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.920720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.920946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.921083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.921308] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.921413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.921477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.921642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.921722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.921835] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be updated. [ 1102.952297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.952458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.952514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.952704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.952852] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.962808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: IN_PROGRESS for 2s [ 1102.963166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.963294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.963364] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.963564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.963718] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.963817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.963881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.964039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.964128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.964217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.964359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.964453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.964525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.964668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.964809] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.964901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.964962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.965179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.965258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.965338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.965425] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.972516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.973113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.973884] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fde72793-519e-47a5-8562-b0a950d1fd4c with status ACTIVE [ 1102.974053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.975023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.975023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.975638] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.975638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.975638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.975638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.975638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.975784] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fde72793-519e-47a5-8562-b0a950d1fd4c is going to be updated. [ 1102.997969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.998982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.998982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.998982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.998982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.998982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fde72793-519e-47a5-8562-b0a950d1fd4c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.185871] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1103.186152] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1103.186256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.186441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.186650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.186859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.187619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.187619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.187619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.187619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.187619] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.195789] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 in Status: SUCCESS [ 1103.196061] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 deletion is rescheduled due to dependency. [ 1103.196218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.467946] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1103.491796] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.492082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.492209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.492356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.492447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.492695] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.492798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.492864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.493063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.493148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.493368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.493457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.493538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.493712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.493788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.493972] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.494080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.494150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.494293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.494369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.494492] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1103.573963] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.573963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.574092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.574339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.574555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.599235] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1103.690237] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.192205] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.694907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.695089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.695161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.695383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.695488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.695598] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1104.725649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.725806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.725876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.726101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.726241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.734783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1104.973910] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef in Status: SUCCESS [ 1104.974115] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef deletion is rescheduled due to dependency. [ 1104.974234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.565911] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.566247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.566306] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.566606] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.566898] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.567081] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.567249] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.567864] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.567864] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.567986] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.568116] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.568256] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.568946] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.568946] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.568946] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.569097] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.589486] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.589666] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.589788] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.590030] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-251" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.590373] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-2223ce3c-4091-40da-b4e8-054c3b3c3432 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.590579] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.590707] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.591093] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.591254] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2223ce3c-4091-40da-b4e8-054c3b3c3432',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.620890] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1105.621160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.093904] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.094155] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.095472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.095939] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.096137] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.096458] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.096627] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.096749] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.097020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.097191] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.097512] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.097835] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.097979] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.098221] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.098362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.098508] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 is going to be updated. [ 1106.119981] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.120234] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.120379] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.120610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.120832] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.121069] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.171442] env[65319]: INFO networking_nsxv3.common.synchronization [req-f4975dce-a492-4749-b882-258ab7bd1750 req-50037fd2-1a39-4c2f-842c-814d3f2b5449 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 1106.172128] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGHEST for action security_group_members [ 1106.172469] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.172597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.172667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.172879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.173047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.173145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.173206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.173350] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.173433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.173528] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.675785] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.676166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.676166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.676370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.676485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.676672] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.676773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.676841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.677034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.677136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.677226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 is going to be updated. [ 1106.711602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.711924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.711924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.712574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.712574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.725202] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: IN_PROGRESS for 2s [ 1106.745877] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 4s [ 1106.874797] env[65319]: INFO networking_nsxv3.common.synchronization [req-f567bc1f-27d5-467d-8ba9-79f5e5eb2b2c req-fde321cb-5db4-40eb-9648-ae5878f398ee service nova] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1106.875526] env[65319]: INFO networking_nsxv3.common.synchronization [req-f567bc1f-27d5-467d-8ba9-79f5e5eb2b2c req-fde321cb-5db4-40eb-9648-ae5878f398ee service nova] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1106.875914] env[65319]: INFO networking_nsxv3.common.synchronization [req-f567bc1f-27d5-467d-8ba9-79f5e5eb2b2c req-fde321cb-5db4-40eb-9648-ae5878f398ee service nova] Enqueued Resource ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 with Priority: HIGHEST for action port [ 1106.876652] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_rules [ 1106.876882] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1106.877088] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 with Priority: HIGHEST for action port [ 1106.881608] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.881869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.881999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.882351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.882512] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.889333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.889593] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.890806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.890806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.890806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.890806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.890806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.890806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.891305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.891305] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.894060] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2223ce3c-4091-40da-b4e8-054c3b3c3432 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.894298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.894298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.894995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.894995] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2223ce3c-4091-40da-b4e8-054c3b3c3432',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.386568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.386717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.394227] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.397748] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2223ce3c-4091-40da-b4e8-054c3b3c3432 with status ACTIVE [ 1107.397851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.397990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.398069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.398281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.398368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.398552] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.398664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.398726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.398867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.398944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.399143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.399236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.399296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.399426] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.399502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.399602] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2223ce3c-4091-40da-b4e8-054c3b3c3432 is going to be updated. [ 1107.436790] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.436989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.437042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.437277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.437421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.437585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2223ce3c-4091-40da-b4e8-054c3b3c3432" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.897098] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.266125] env[65319]: INFO networking_nsxv3.common.synchronization [req-f1e7f631-435d-4ad9-82fe-4bdd7a671637 req-ea550934-dd56-45d1-a589-4e1291b83973 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1108.266588] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1108.267262] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.269277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.269277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.269389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.269809] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.269809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.269809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.270176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.270176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.270176] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.399217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.399459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.399459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.399623] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.399716] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.399819] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be updated. [ 1108.436061] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.436253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.436316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.436549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.436718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.447805] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: IN_PROGRESS for 2s [ 1108.735502] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 in Status: SUCCESS [ 1108.735687] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 deletion is rescheduled due to dependency. [ 1108.735804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.754945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1108.755206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.755376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.755597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.755800] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.755933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.755999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.756170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.756251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.756360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.756412] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.772451] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.258961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.259383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.259383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.259480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.259595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.259691] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.259755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.259897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.260034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.260139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.260293] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.260417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.260484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.260628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.260766] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.260858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.260916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.261070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.261146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.261223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.261312] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.274947] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.764442] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95d83bf-87be-46fb-a121-6221d6adfa83: rpc.has_security_group_logging(os_id): False [ 1109.777782] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.777782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.777941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.778062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.778148] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.778250] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1109.784584] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.784584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.784791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.784829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.784928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.785117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.785223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.785285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.785434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.785509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.785719] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.785815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.785875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.786024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.786098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.786289] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.786373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.786432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.786567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.786640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.786757] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1109.811110] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.811466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.811466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.811534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.811667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.821195] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1109.861552] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.861723] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.861784] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.861973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.862142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.878484] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1110.457550] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: SUCCESS [ 1110.458048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.458048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.458143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.458340] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.458457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.458520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.458699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.458780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.458864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.458955] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.961350] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.464293] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 168faf57-13be-4d1b-8a5c-4618e12dde52: rpc.has_security_group_logging(os_id): False [ 1111.484589] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.484772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.484855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.485080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.505282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.505677] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.505898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.505898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.506129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.506214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.506306] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be updated. [ 1111.581864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.582068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.582173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.582409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.582564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.596665] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: IN_PROGRESS for 2s [ 1111.833505] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1111.833842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.894347] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1111.894630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.697420] env[65319]: INFO networking_nsxv3.common.synchronization [req-16cc9638-bc86-408f-a452-828f57c5465d req-215ae010-7128-4d1e-89ca-9a40ee4f2c52 tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1112.697968] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1112.698285] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.698406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.698473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.698717] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.698894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.698992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.700808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.700808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.700924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.701011] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.011347] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.011522] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.011599] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.011911] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.012190] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.012354] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.012484] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.012708] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.012853] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.013082] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.013230] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.013359] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.013447] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.013559] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.013661] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.013793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.034445] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.034645] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.034800] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.035016] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.035373] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.035564] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.035723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.036080] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.036242] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c58c66d6-f0d4-4f41-9165-dfc2e6e48275',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.206522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.206690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.206763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.206986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.207091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.207297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.207398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.207462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.207616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.207692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.207808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 already deleted. [ 1113.207878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.538699] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.539067] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.539166] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.539580] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.539771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.539959] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port c58c66d6-f0d4-4f41-9165-dfc2e6e48275 not found, creating... [ 1113.540305] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.540509] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.540907] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.541251] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.541435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.541947] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.542179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.542299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.542625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.542781] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.542925] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: c58c66d6-f0d4-4f41-9165-dfc2e6e48275 is going to be created. [ 1113.585589] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.585842] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.585998] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.586362] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.586637] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.586908] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.615104] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: SUCCESS [ 1113.615423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [req-16cc9638-bc86-408f-a452-828f57c5465d req-5f5e943d-8835-4f3d-9a25-c8fa8b8a9f1e service nova] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_rules [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [req-16cc9638-bc86-408f-a452-828f57c5465d req-5f5e943d-8835-4f3d-9a25-c8fa8b8a9f1e service nova] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [req-16cc9638-bc86-408f-a452-828f57c5465d req-5f5e943d-8835-4f3d-9a25-c8fa8b8a9f1e service nova] Enqueued Resource ID: c58c66d6-f0d4-4f41-9165-dfc2e6e48275 with Priority: HIGHEST for action port [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_rules [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1114.301145] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c58c66d6-f0d4-4f41-9165-dfc2e6e48275 with Priority: HIGHEST for action port [ 1114.301145] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.301145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.301145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.301145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.301145] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.302486] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.302486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.302486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.302486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.302486] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.302789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.302789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.302789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.302789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.302892] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.307549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.307549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.307549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.307549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.307549] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c58c66d6-f0d4-4f41-9165-dfc2e6e48275',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.808324] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.808464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.808699] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.809628] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c58c66d6-f0d4-4f41-9165-dfc2e6e48275 with status ACTIVE [ 1114.809819] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.809941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.810014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.810260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.810352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.810536] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.810640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.810703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.810861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.810944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.813550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.813689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.813757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.813932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.814030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.814125] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c58c66d6-f0d4-4f41-9165-dfc2e6e48275 is going to be updated. [ 1114.840434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.840617] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.840675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.840890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.841039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.841210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c58c66d6-f0d4-4f41-9165-dfc2e6e48275" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.070364] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3cc6649b-41d3-45ca-828a-ac3818dfb46e tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1115.070721] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1115.071283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.071557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.071631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.071946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.072038] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.156470] env[65319]: INFO networking_nsxv3.common.synchronization [None req-476d57f6-8e8e-40e3-ade6-0b36de58018d tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1115.157130] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1115.157641] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.157831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.316265] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.600094] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.600368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.600368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.600618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.600618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.600738] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 already deleted. [ 1115.600788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.600981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.601151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.601236] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.822100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.822276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.822349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.822564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.822654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.822753] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be created. [ 1115.856217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.856382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.856448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.856658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.856831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.868300] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: UNINITIALIZED for 2s [ 1116.122507] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.122872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.122931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.123203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.123322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.123455] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 already deleted. [ 1116.123563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.949206] env[65319]: INFO networking_nsxv3.common.synchronization [req-c6634148-672c-4bb1-afd1-1faf1ea2a084 req-3dc5a0af-5eab-4c32-a5ec-f65328d4021d tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1116.949722] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1116.950093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.950214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.301018] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.301018] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.301018] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.301018] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.301018] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.301018] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.301018] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.301556] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.301556] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.301556] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.323435] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.323611] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.323750] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.323932] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.324276] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-ea60f6f0-7827-4a0d-96c1-ca94724987e8 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.324503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.324568] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.324923] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.325101] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea60f6f0-7827-4a0d-96c1-ca94724987e8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.827268] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.827461] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.828034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.828034] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.828192] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.828346] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port ea60f6f0-7827-4a0d-96c1-ca94724987e8 not found, creating... [ 1117.828673] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.829303] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.829303] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.829471] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.829750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.830132] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.830332] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.830453] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.830694] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.830871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.831122] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: ea60f6f0-7827-4a0d-96c1-ca94724987e8 is going to be created. [ 1117.862132] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.862420] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.862521] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.862770] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.863051] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.863241] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886579] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1117.886871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.887046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.887243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.887475] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.887620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.887688] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.888033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.888215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.888332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.888481] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.889662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.890400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.890400] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.890400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.890400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.890622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.890622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.890622] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.392365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.392732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.392732] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.607023] env[65319]: INFO networking_nsxv3.common.synchronization [req-c6634148-672c-4bb1-afd1-1faf1ea2a084 req-14c1ff5c-9333-47e1-96d7-ff32913aa177 service nova] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_rules [ 1118.607023] env[65319]: INFO networking_nsxv3.common.synchronization [req-c6634148-672c-4bb1-afd1-1faf1ea2a084 req-14c1ff5c-9333-47e1-96d7-ff32913aa177 service nova] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1118.607023] env[65319]: INFO networking_nsxv3.common.synchronization [req-c6634148-672c-4bb1-afd1-1faf1ea2a084 req-14c1ff5c-9333-47e1-96d7-ff32913aa177 service nova] Enqueued Resource ID: ea60f6f0-7827-4a0d-96c1-ca94724987e8 with Priority: HIGHEST for action port [ 1118.607639] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_rules [ 1118.607903] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1118.608131] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea60f6f0-7827-4a0d-96c1-ca94724987e8 with Priority: HIGHEST for action port [ 1118.608612] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.608844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.609315] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.611480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.611480] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea60f6f0-7827-4a0d-96c1-ca94724987e8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.611480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.611480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.611480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.611480] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea60f6f0-7827-4a0d-96c1-ca94724987e8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.895931] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.112617] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea60f6f0-7827-4a0d-96c1-ca94724987e8 with status ACTIVE [ 1119.114226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.114226] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.114226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.114681] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.114681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.114681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.114681] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.114877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.114974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea60f6f0-7827-4a0d-96c1-ca94724987e8 is going to be updated. [ 1119.138373] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.138514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.138565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.138835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.139047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.139241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea60f6f0-7827-4a0d-96c1-ca94724987e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.402562] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.402562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.402562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.402562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.402562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.402562] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be updated. [ 1119.436853] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.437025] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.437101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.437325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.437483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.451744] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1121.007388] env[65319]: INFO networking_nsxv3.common.synchronization [None req-91ea3603-3fd4-4b16-815f-66adc1eec345 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1121.008018] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1121.008394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.008523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.008607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.009321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.009414] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.091674] env[65319]: INFO networking_nsxv3.common.synchronization [None req-f06acaca-fbe2-4548-87e5-287f9195afb4 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1121.092464] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1121.092549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.092677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.463016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1121.463016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.463016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.463016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.463351] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.463351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.463455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.465049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.465049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.465049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.465049] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.466952] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.466952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.466952] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.529936] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.529936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.529936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.530259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.530374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.530476] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 already deleted. [ 1121.530579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.530730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.530899] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.530981] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.968378] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839965b7-f21e-4ee2-ae26-d772962e5f52: rpc.has_security_group_logging(os_id): False [ 1121.969467] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.988648] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.988834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.988834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.989178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.989278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.990034] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.990034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.990034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.990034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.990034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.990349] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.990349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.990349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.990458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.990494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.990690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.990794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.990855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.990999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.991088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.991177] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be created. [ 1122.049434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.049802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.049802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.049884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.050062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.055802] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.056032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.056107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.056272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.056363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.056458] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 already deleted. [ 1122.056538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.061530] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1122.471482] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.974659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.974659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.974659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.974895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.974895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.976583] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be updated. [ 1123.009792] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.009792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.009792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.010217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.010217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.018992] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1124.073721] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1124.074048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.074204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.074455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.074550] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.578056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.578225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.028779] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1125.029047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.029276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.029503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.029703] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.029827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.029888] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.030056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.030140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.030215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.030337] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.533089] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.533472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.533472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.533597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.533771] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.533982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.533982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.534183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.534334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.534413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.534568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.534689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.534752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.534897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.535056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.535151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.535211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.535351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.535429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.535509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.535618] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.004711] env[65319]: INFO networking_nsxv3.common.synchronization [req-bfa89940-9336-4ba7-943e-bc58dfbcf8e1 req-5660d9ce-9bb8-4f35-a01c-98354887773e tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1126.005696] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1126.006620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.006620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.006620] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.006778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.006965] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.007128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.007212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.007421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.007536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.007665] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.038355] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839965b7-f21e-4ee2-ae26-d772962e5f52: rpc.has_security_group_logging(os_id): False [ 1126.060032] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.060191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.060286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.060582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.060827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.061187] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.061303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.061369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.061561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.061653] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.061978] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.062181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.062296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.062525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.062689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.062923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.063059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.063144] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.063515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.063663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.063791] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be updated. [ 1126.125499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.125499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.125499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.125499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.125499] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.139892] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1126.510021] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.012138] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.515343] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.515511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.515628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.515804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.515898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.515998] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1127.605076] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.605419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.605419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.605518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.605658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.615622] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1128.154537] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1128.155094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.628415] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1129.628765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.007328] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1131.007866] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1133.317776] env[65319]: INFO networking_nsxv3.common.synchronization [req-6df1f455-0b71-48b9-88bc-a91c15bdce2c req-c1eccdf8-e26b-4ecd-8077-4b1f5a75a59a tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1133.318526] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1133.318781] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.318907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.318997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.320837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.321019] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.321186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.321186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.321771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.321771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.321771] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.691960] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.692182] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.692308] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.692598] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.692864] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.693031] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.693151] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.693369] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.693514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.693714] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.693824] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.693929] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.694043] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.694150] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.694252] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.694379] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.807503] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.807503] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.113 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.807687] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.807830] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.808195] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.808383] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.808505] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.808826] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.808967] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.823227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.823382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.823444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.823651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.823782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.823971] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.824102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.824168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.824331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.824408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.824494] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 already deleted. [ 1133.824574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.312901] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.313261] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.313413] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.313767] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.313974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.314199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 not found, creating... [ 1134.314573] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.315046] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.315046] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.315256] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.315472] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.316337] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.316570] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.316750] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.317035] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.317224] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.317417] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 is going to be created. [ 1134.339464] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.339857] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.339955] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.340286] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.340603] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.340896] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.940978] env[65319]: INFO networking_nsxv3.common.synchronization [req-6df1f455-0b71-48b9-88bc-a91c15bdce2c req-27dfc411-787f-4c1b-b5e3-c1df1588f4bc service nova] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1134.941307] env[65319]: INFO networking_nsxv3.common.synchronization [req-6df1f455-0b71-48b9-88bc-a91c15bdce2c req-27dfc411-787f-4c1b-b5e3-c1df1588f4bc service nova] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1134.941307] env[65319]: INFO networking_nsxv3.common.synchronization [req-6df1f455-0b71-48b9-88bc-a91c15bdce2c req-27dfc411-787f-4c1b-b5e3-c1df1588f4bc service nova] Enqueued Resource ID: 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 with Priority: HIGHEST for action port [ 1134.941865] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1134.942015] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1134.942107] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 with Priority: HIGHEST for action port [ 1134.942389] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.942512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.942577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.943062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.943062] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.943847] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.944187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.944187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.944288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.944353] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.944472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.944525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.944726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.944726] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.944832] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.946814] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.946814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.946814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.946814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.946814] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.449138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.449138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.449138] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.449782] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 with status ACTIVE [ 1135.449916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.450035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.450240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.450425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.450528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.450728] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.450832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.450882] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.451065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.451141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.451351] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.451847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.451945] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.452084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.452150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.452239] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500 is going to be updated. [ 1135.478117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.478866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.478866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.478866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.478866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.479277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d5788cb-4cbb-4c3f-bbc7-c7f840e7a500" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.678929] env[65319]: INFO networking_nsxv3.common.synchronization [req-8d8427ff-06c5-4f8c-a031-9d01e1c1205e req-c296e861-c9a2-4658-8747-a064c1d6f38e tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1135.679714] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1135.680169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.680354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.680807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.681322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.681394] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.681493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.681583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.681843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.681892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.682025] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.955803] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.978942] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.978942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.978942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.978942] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.979316] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.979316] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.979418] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.979568] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.979766] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.980027] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.980143] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.980251] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.980358] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.980464] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.980598] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.980736] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.000029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.000215] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.000350] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.000588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.000946] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-56c2de81-627c-4a94-8195-bc7a6cc26163 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.001139] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.001257] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.001587] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.001721] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c2de81-627c-4a94-8195-bc7a6cc26163',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.186260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.186260] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.186260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.186531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.186531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 already deleted. [ 1136.186531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.457286] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.457655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.457655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.457722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.457805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.457909] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be created. [ 1136.480942] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.481203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.481203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.481398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.481586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.493937] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: UNINITIALIZED for 2s [ 1136.504270] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.504505] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.504630] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.504924] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.505095] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.505292] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 56c2de81-627c-4a94-8195-bc7a6cc26163 not found, creating... [ 1136.505550] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.505713] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.505831] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.506154] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.506536] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.506841] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.507009] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.507132] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.507340] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.507476] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.507614] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 56c2de81-627c-4a94-8195-bc7a6cc26163 is going to be created. [ 1136.527163] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.527377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.527503] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.527760] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.527981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.528260] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [req-8d8427ff-06c5-4f8c-a031-9d01e1c1205e req-6a078a2f-cbd9-42f0-9031-962c96425f2b service nova] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [req-8d8427ff-06c5-4f8c-a031-9d01e1c1205e req-6a078a2f-cbd9-42f0-9031-962c96425f2b service nova] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [req-8d8427ff-06c5-4f8c-a031-9d01e1c1205e req-6a078a2f-cbd9-42f0-9031-962c96425f2b service nova] Enqueued Resource ID: 56c2de81-627c-4a94-8195-bc7a6cc26163 with Priority: HIGHEST for action port [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_rules [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1137.238924] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c2de81-627c-4a94-8195-bc7a6cc26163 with Priority: HIGHEST for action port [ 1137.238924] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.239751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.239992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.240287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.240450] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.242079] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.242838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.242838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.242838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.242838] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.242838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.242838] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.243107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.243107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.243171] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.245283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c2de81-627c-4a94-8195-bc7a6cc26163 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.245452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.247282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.247282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.247282] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c2de81-627c-4a94-8195-bc7a6cc26163',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.743182] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.743525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.745756] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.747639] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56c2de81-627c-4a94-8195-bc7a6cc26163 with status ACTIVE [ 1137.747639] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.747639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.747639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.747842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.749039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.749039] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.749039] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.749527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.749527] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56c2de81-627c-4a94-8195-bc7a6cc26163 is going to be updated. [ 1137.779788] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.780362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.780439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.780661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.781480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.781480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c2de81-627c-4a94-8195-bc7a6cc26163" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.248061] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.504256] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1138.504491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.504679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.504903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.505780] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.505780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.505780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.505780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.505780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.505780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.505780] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.750414] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.750792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.750792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.750866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.750923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.751029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 is going to be created. [ 1138.779125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.779401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.779401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.779734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.779878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.790480] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: UNINITIALIZED for 2s [ 1139.008396] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.511910] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47634945-8e30-46dc-82da-93cd5685cbc3: rpc.has_security_group_logging(os_id): False [ 1139.529894] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.530120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.530120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.530441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.530602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.530917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.531099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.531131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.531370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.531453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.531582] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be created. [ 1139.594130] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.594278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.594344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.594562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.594827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.613378] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1140.805540] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: SUCCESS [ 1140.805540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.805540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.805540] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.805540] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.806293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.806293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.806293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.806293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.806293] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.806486] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.309237] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.625436] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1141.625665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.811793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7: rpc.has_security_group_logging(os_id): False [ 1141.829649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.829840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.829934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.830206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.830316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.830606] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.830742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.830820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.831013] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.831101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.831207] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 is going to be created. [ 1141.902163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.902379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.902529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.902819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.903022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.915150] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: IN_PROGRESS for 2s [ 1142.239590] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1142.239763] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1143.930490] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: SUCCESS [ 1143.930968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.450372] env[65319]: INFO networking_nsxv3.common.synchronization [req-6958becf-f68e-4d3e-8cf8-b511258eb6ed req-3564ecbd-5618-4966-816d-c44bf7e6b86c tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1146.451644] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1146.451644] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.451644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.451644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.451956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.451956] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.452047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.452099] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.452442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.452442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.452442] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.787020] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.787020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.787020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.787363] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.787749] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.788084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.788329] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.788675] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.788978] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.789599] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.789599] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.791928] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.791928] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.791928] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.791928] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.791928] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.812930] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.812930] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.812930] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.812930] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.812930] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.812930] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.812930] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.812930] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.812930] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.955217] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.315412] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.315725] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.316028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.316373] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.316542] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.316834] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 not found, creating... [ 1147.316974] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.317152] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.317269] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.317497] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.317664] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.317953] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.318169] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.318272] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.318448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.318584] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.318726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 is going to be created. [ 1147.339364] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.339625] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.340520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.340520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.340520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.340520] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.438662] env[65319]: INFO networking_nsxv3.common.synchronization [req-d15b8f31-a3af-4d21-b206-0cc2a0218c8d req-76bc84a4-c95f-4c0d-8457-c106889c89c6 tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1147.439571] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1147.440109] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.440195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.440310] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.440597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.440855] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.441033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.441127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.441387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.441518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.441666] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.456787] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.943746] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.959214] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.959514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.960457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.961251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.961251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.961251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1147.999469] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.999469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.999469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.999469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.999469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.010726] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1148.119663] env[65319]: INFO networking_nsxv3.common.synchronization [req-6958becf-f68e-4d3e-8cf8-b511258eb6ed req-bb91cd04-7fe9-4fc6-81aa-eee67bee8df4 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1148.119937] env[65319]: INFO networking_nsxv3.common.synchronization [req-6958becf-f68e-4d3e-8cf8-b511258eb6ed req-bb91cd04-7fe9-4fc6-81aa-eee67bee8df4 service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1148.120143] env[65319]: INFO networking_nsxv3.common.synchronization [req-6958becf-f68e-4d3e-8cf8-b511258eb6ed req-bb91cd04-7fe9-4fc6-81aa-eee67bee8df4 service nova] Enqueued Resource ID: 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 with Priority: HIGHEST for action port [ 1148.121346] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1148.121552] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1148.121698] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 with Priority: HIGHEST for action port [ 1148.122074] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.122251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.122328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.122610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.122644] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.125086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.125086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.125086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.125086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.125086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.125086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.125086] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.447525] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.627490] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.627809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.627809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 with status ACTIVE [ 1148.627986] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.628107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.628173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.628376] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.628476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.628656] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.628753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.628816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.628965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.629055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.629235] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.629329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.629389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.629572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.629634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.629717] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3 is going to be updated. [ 1148.653239] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.653446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.653446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.653641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.653780] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.654121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914e3a5a-5625-4e2e-ba9a-d8eb5dcb0bf3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.951880] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.952049] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.952183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.952331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.952429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.952552] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be updated. [ 1148.985255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.985404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.985478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.985706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.985862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.995594] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 1150.022870] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1150.023234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.023374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.023627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.023835] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.023988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.024061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.024251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.024336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.024463] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.039782] env[65319]: INFO networking_nsxv3.common.synchronization [req-e9942b2b-9935-4507-8ccd-58eac091b550 req-d326a510-9e49-41ce-a3bc-a4750e3c6780 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1150.040494] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1150.040757] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.040932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.041033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.041235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.041408] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.041530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.041633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.041931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.041994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.042071] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.411710] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.411871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.412007] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.412329] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.412636] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.412842] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.413007] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.413301] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.413489] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.413748] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1150.413891] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.414034] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.414183] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.414317] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1150.414467] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.414632] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.439833] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.440020] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1150.440166] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.440337] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.440659] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.440884] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.440920] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.441276] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.441417] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be79acd-9ab4-4deb-bed0-8cbfce6ae496',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.528381] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.545112] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.783691] env[65319]: INFO networking_nsxv3.common.synchronization [req-912229d7-e910-4eec-9807-6027f0547b40 req-1584e7e9-fad3-470c-b3f3-a137d670b5f5 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1150.784315] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1150.784690] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.784846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.784924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.785173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.785359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.785467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.785542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.785714] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.785805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.786489] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.944057] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.944468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.944468] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.944778] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.944952] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.945145] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 not found, creating... [ 1150.945515] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.945615] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.945681] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.945928] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.946092] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.946383] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.946533] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.946733] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.946854] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.946987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.947151] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 is going to be created. [ 1150.971385] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.971385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.971385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.971385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.971385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.971385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.005655] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 1151.005931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.030573] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.046434] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.126360] env[65319]: INFO networking_nsxv3.common.synchronization [None req-be6c5e7c-afe9-4fb0-a46a-87a0f35b67c7 tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1151.127374] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1151.127460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.127581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.127656] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.127951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.128136] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.266968] env[65319]: INFO networking_nsxv3.common.synchronization [None req-14e2be83-9390-484a-9446-7524ae96df8f tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1151.267475] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1151.267810] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.267925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.288550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.288732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.288828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.289147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.310634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.310903] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.311038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.311107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.311308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.311389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.311479] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1151.338817] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.338955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.339047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.339255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.339396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.348289] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1151.535300] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.535549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.535549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.535811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.537074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.537267] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1151.548671] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.548877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.548925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.549164] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.549265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.549341] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be updated. [ 1151.577342] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.577342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.577342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.578020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.578020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.588633] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.588795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.588964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.589089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.589211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.590902] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1151.598320] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1151.651063] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.651259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.651313] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.651622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.652016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.652016] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 already deleted. [ 1151.652016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.652204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.652400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.652513] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.710866] env[65319]: INFO networking_nsxv3.common.synchronization [req-e9942b2b-9935-4507-8ccd-58eac091b550 req-ded50738-27b6-4884-af44-13ee4cbed6a9 service nova] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1151.710866] env[65319]: INFO networking_nsxv3.common.synchronization [req-e9942b2b-9935-4507-8ccd-58eac091b550 req-ded50738-27b6-4884-af44-13ee4cbed6a9 service nova] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1151.710866] env[65319]: INFO networking_nsxv3.common.synchronization [req-e9942b2b-9935-4507-8ccd-58eac091b550 req-ded50738-27b6-4884-af44-13ee4cbed6a9 service nova] Enqueued Resource ID: 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 with Priority: HIGHEST for action port [ 1151.713640] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_rules [ 1151.713843] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1151.714084] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 with Priority: HIGHEST for action port [ 1151.715876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.715995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.716316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.716990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.717111] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.718082] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.718377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.718840] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.718973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.719052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.719254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.719338] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be79acd-9ab4-4deb-bed0-8cbfce6ae496',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.173704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.173704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.173704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.174659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.174659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.174659] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 already deleted. [ 1152.174659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.221333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.221514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.221743] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 with status ACTIVE [ 1152.221923] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.222058] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.222165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.222339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.222428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.222630] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.222735] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.222799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.222959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.227126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.227374] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.227485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.227547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.227736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.227829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.227922] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5be79acd-9ab4-4deb-bed0-8cbfce6ae496 is going to be updated. [ 1152.250258] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.250258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.250258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.250258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.250258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.250258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5be79acd-9ab4-4deb-bed0-8cbfce6ae496" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.362062] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1153.362348] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa deletion is rescheduled due to dependency. [ 1153.362397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.602015] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1153.602612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.602612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.602612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.602814] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.602944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.603055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.603187] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.603268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.603359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.603453] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.606387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1153.606577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.606729] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.607283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.607283] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.607283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.607283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.607425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.607515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.607567] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.105743] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.105846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.105884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.106587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.106587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.106587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.106587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.106587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.106794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.106794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.106900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.107031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.107112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.107272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.107431] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.107545] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.107609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.107754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.107833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.107963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.108140] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.109213] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.613502] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1154.614604] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.633362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.633511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.633881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.634176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.634332] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.634779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.634846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.634939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.635154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.636056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.636056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.636056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.636056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.636056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.636056] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.636056] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.636391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.636391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.636391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.636391] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.636511] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1154.703029] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.703029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.703029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.703029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.703029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.713959] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1155.118074] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.118074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.118074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.118247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.118322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.118426] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be updated. [ 1155.155067] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.155067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.155271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.155403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.155973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.167882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1155.602800] env[65319]: INFO networking_nsxv3.common.synchronization [None req-60b97751-928a-44b7-ae64-148986ed7543 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a with Priority: HIGHEST for action security_group_rules [ 1155.603459] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a with Priority: HIGHEST for action security_group_rules [ 1155.603808] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.603894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.603934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.604207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.604289] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42fce186-232d-4d1a-82c5-9f62bf3d3b0a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.688569] env[65319]: INFO networking_nsxv3.common.synchronization [None req-d4f2c8a7-4924-4ea4-a1ca-1dceb9a78db1 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a with Priority: HIGHEST for action security_group_rules [ 1155.689386] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a with Priority: HIGHEST for action security_group_rules [ 1155.689879] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.690047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.124775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.124775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.124775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.125161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.125161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.125161] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a already deleted. [ 1156.125286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.125338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.125518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.125606] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42fce186-232d-4d1a-82c5-9f62bf3d3b0a',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.647788] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.648044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.648044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.648277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.648377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.648478] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42fce186-232d-4d1a-82c5-9f62bf3d3b0a already deleted. [ 1156.648563] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42fce186-232d-4d1a-82c5-9f62bf3d3b0a" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.731471] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1156.731471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.180076] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1157.180311] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.180481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.180708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.180906] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.181071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.181133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.181298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.181377] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.181464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.181556] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.683917] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.186752] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47634945-8e30-46dc-82da-93cd5685cbc3: rpc.has_security_group_logging(os_id): False [ 1158.204615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.204791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.204880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.205107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.205207] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.205450] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.205550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.205610] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.205761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.205837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.205924] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be updated. [ 1158.277900] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.278074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.278149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.278363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.278515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.292040] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1158.739654] env[65319]: INFO networking_nsxv3.common.synchronization [req-e24a5a4f-d2b9-4e54-ba4c-731442d8f411 req-4afad25a-0d13-4070-ba01-78b636a333cd tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1158.740226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1158.740545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.740665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.740730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.740923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.741091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.741190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.741280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.742088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.742088] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.742088] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.244371] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.244763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.244763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.244832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.244879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.245083] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.245183] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.245247] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.245401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.245506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.245599] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1159.276135] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.276303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.276368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.276578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.276835] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.287201] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1159.628826] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edcee21-4024-4491-889e-acbcec503e8f req-3c8d62c2-2839-4fc6-9234-46b5ee98fd1e tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1159.629484] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1159.629870] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.630096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.630323] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.630586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.630733] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.630843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.630843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.631052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.631130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.631180] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.974100] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.974391] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.974453] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.975489] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.975489] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.975489] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.975489] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.975716] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.975792] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.976150] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.976332] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.976508] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.976686] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.976870] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.977071] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.977226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.998251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.998426] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.998563] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.998828] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-442" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.999162] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.999341] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.999475] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.999825] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.999972] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10aa26ce-cc37-4a8b-8028-58a2ba97cb58',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.134146] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.134308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.134383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.134609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.134701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.134899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.134998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.135070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.135226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.135289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.135376] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 already deleted. [ 1160.135459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.307110] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1160.307340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.502149] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.502394] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.502620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.502797] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.502947] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.503156] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 not found, creating... [ 1160.503974] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.504194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.504728] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.505054] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.505177] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.505473] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.505633] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.505754] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.505972] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.506166] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.506312] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 is going to be created. [ 1160.526368] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.526631] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.526756] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.527203] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.527450] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.527676] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.241473] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edcee21-4024-4491-889e-acbcec503e8f req-6b59cffe-3f1e-497c-b602-69ddefc4ffc5 service nova] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1161.241665] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edcee21-4024-4491-889e-acbcec503e8f req-6b59cffe-3f1e-497c-b602-69ddefc4ffc5 service nova] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1161.241804] env[65319]: INFO networking_nsxv3.common.synchronization [req-6edcee21-4024-4491-889e-acbcec503e8f req-6b59cffe-3f1e-497c-b602-69ddefc4ffc5 service nova] Enqueued Resource ID: 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 with Priority: HIGHEST for action port [ 1161.244503] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_rules [ 1161.245051] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1161.245051] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 with Priority: HIGHEST for action port [ 1161.245438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.245514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.245580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.245788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.245887] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.246716] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.246828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.246892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.247270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.247852] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.251331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.251440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.251886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.251886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.251886] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.252997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.252997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.252997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.253214] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.253214] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10aa26ce-cc37-4a8b-8028-58a2ba97cb58',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.297862] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1161.298065] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1161.298184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.412990] env[65319]: INFO networking_nsxv3.common.synchronization [None req-96e64efc-64d7-435b-a45d-b280576faea0 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1161.413489] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1161.413790] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.413912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.413991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.414420] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.416264] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.416409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.416464] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.416705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.416785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.416857] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.477568] env[65319]: INFO networking_nsxv3.common.synchronization [req-d51efbcc-1ac6-4c13-a59c-9aded091b23f req-5a9f4948-cd77-47ae-becf-d1bef5afeeec tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1161.478151] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1161.478549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.481132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.481132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.481132] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.755253] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.755253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.756349] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.757196] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 with status ACTIVE [ 1161.757382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.757510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.757577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.757777] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.757866] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.758042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.758141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.758234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.758347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.758423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.758602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.758692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.758785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.758912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.760592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.760592] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10aa26ce-cc37-4a8b-8028-58a2ba97cb58 is going to be updated. [ 1161.782504] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.782661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.782732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.782944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.783098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.783260] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10aa26ce-cc37-4a8b-8028-58a2ba97cb58" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.872949] env[65319]: INFO networking_nsxv3.common.synchronization [req-99330b91-8b63-4e6c-823e-555cb7fbcf76 req-72dcd77d-408b-4dee-aec3-60acc0250efd tempest-AttachVolumeShelveTestJSON-746279339 tempest-AttachVolumeShelveTestJSON-746279339-project-member] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1161.873521] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGHEST for action security_group_members [ 1161.874008] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.875044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.875254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.875547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.875784] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.875938] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.876040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.876237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.876356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.876480] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.918789] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.919116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.919242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.919400] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.919491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.919684] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.919811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.919861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.919987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.920074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.920159] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1161.953257] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.953257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.953257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.953577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.953577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.964081] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1161.987759] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.261323] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.383573] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.383748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.383805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.384123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.384261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.384655] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.384782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.384919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.385198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.385295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.385399] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be updated. [ 1162.416021] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.416397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.416397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.416533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.416753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.425981] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: IN_PROGRESS for 2s [ 1162.490027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.764424] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.764598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.764703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.764895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.764986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.765096] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 is going to be created. [ 1162.793355] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.793584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.793765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.794030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.794234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.814302] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: UNINITIALIZED for 2s [ 1162.993165] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.993455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.993455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.993645] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.993677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.993767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1163.021797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.022020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.022020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.022309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.022466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.033197] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1163.733357] env[65319]: INFO networking_nsxv3.common.synchronization [req-e0cd7e1e-137c-4706-87ba-4706cf4a085c req-e73688ad-0eb4-432a-976a-dd60dd46d848 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1163.733916] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1163.734360] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.734488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.734557] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.734756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.734914] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.736541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.738434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.738682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.738871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.738979] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.975209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1163.975498] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f deletion is rescheduled due to dependency. [ 1163.975733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.051529] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.051761] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.051836] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.052112] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.052361] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.052515] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.052628] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.052850] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.052992] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.053219] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.053333] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.053438] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.053542] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.053649] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.053755] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.053886] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.073757] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.073977] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.074133] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.074307] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.074780] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-8662d886-0545-4d54-94d9-15174ea01055 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.075121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.075314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.075635] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.075776] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8662d886-0545-4d54-94d9-15174ea01055',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.242213] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.242387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.242447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.242680] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.242873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.242981] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.243096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.243162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.243307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.243386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.243472] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1164.276491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.276748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.276748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.276974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.277155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.287315] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1164.437684] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 in Status: SUCCESS [ 1164.437780] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 deletion is rescheduled due to dependency. [ 1164.437892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.578516] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.578789] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.579114] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.579498] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.579700] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.580071] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 8662d886-0545-4d54-94d9-15174ea01055 not found, creating... [ 1164.580450] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.580671] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.580823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.581243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.581243] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.581553] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.581726] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.581845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.582060] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.582217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.582571] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 8662d886-0545-4d54-94d9-15174ea01055 is going to be created. [ 1164.602225] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.602512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.602574] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.602822] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.603066] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.603286] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.827913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: SUCCESS [ 1164.828248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.828353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.828577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.828806] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.829168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.829168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.829235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.829269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.829347] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.829442] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.043554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1165.044635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.309595] env[65319]: INFO networking_nsxv3.common.synchronization [req-e0cd7e1e-137c-4706-87ba-4706cf4a085c req-e2626f56-d5e0-4918-88f6-439297c3dd15 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1165.309912] env[65319]: INFO networking_nsxv3.common.synchronization [req-e0cd7e1e-137c-4706-87ba-4706cf4a085c req-e2626f56-d5e0-4918-88f6-439297c3dd15 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1165.309979] env[65319]: INFO networking_nsxv3.common.synchronization [req-e0cd7e1e-137c-4706-87ba-4706cf4a085c req-e2626f56-d5e0-4918-88f6-439297c3dd15 service nova] Enqueued Resource ID: 8662d886-0545-4d54-94d9-15174ea01055 with Priority: HIGHEST for action port [ 1165.310588] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1165.310746] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1165.310888] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8662d886-0545-4d54-94d9-15174ea01055 with Priority: HIGHEST for action port [ 1165.311785] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.311883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.311883] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.312112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.312197] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.313824] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.313927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.314222] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-8662d886-0545-4d54-94d9-15174ea01055 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.314473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.314473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.314473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.314591] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8662d886-0545-4d54-94d9-15174ea01055',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.331118] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.418710] env[65319]: INFO networking_nsxv3.common.synchronization [req-1e1cdaed-1796-4b75-800c-c1a5e29b25e1 req-64dff722-f3f0-49ef-870b-e6042861028f tempest-ServerActionsTestOtherA-1040889278 tempest-ServerActionsTestOtherA-1040889278-project-member] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1165.419486] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGHEST for action security_group_members [ 1165.419980] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.420204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.420331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.420621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.420868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.421051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.421169] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.421414] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.421559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.421717] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.816590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.816822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.816904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8662d886-0545-4d54-94d9-15174ea01055 with status ACTIVE [ 1165.817189] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.817189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.818188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.818188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.818188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.818188] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.818188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.818188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.818413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.818446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.818652] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.818809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.818864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.818987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.819080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.819166] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8662d886-0545-4d54-94d9-15174ea01055 is going to be updated. [ 1165.833010] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe2f924d-86a5-4614-914f-e20be4da25d9: rpc.has_security_group_logging(os_id): False [ 1165.850765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.851014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.851128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.852253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.852253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.852253] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8662d886-0545-4d54-94d9-15174ea01055" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.853094] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.853094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.853094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.853222] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.854168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.854168] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.854168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.854168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.854168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.854168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.854168] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 is going to be created. [ 1165.922378] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.923034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.923034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.923034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.923034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.924904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.924904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.924904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.924904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.924904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.924904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.924904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.925288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.925288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.925288] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.925288] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be updated. [ 1165.941806] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: IN_PROGRESS for 2s [ 1165.959352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.959502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.959554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.959775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.959944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.969904] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: IN_PROGRESS for 2s [ 1166.045760] env[65319]: INFO networking_nsxv3.common.synchronization [req-f66b3a1c-0699-4c7f-a401-5b8b0d63de60 req-e792ed52-1363-4491-8f45-e4328be787a3 tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1166.046443] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1166.046828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.046949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.047024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.047244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.047407] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.047504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.047564] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.047710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.047813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.047925] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.304018] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1166.304018] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.304018] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.304018] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.304018] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.421895] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.422160] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.422236] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.422508] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.422814] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.422991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.423099] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.423317] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.423460] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.423696] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.423842] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.423987] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.424086] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.424228] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.424408] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.424619] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.447490] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.447747] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1166.447998] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.448239] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-617" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.448737] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-b204302a-9ec7-4755-9c52-da86b2682c47 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.449011] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.449143] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.449610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.449812] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b204302a-9ec7-4755-9c52-da86b2682c47',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.552236] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.552487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.552582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.552819] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.552951] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.553960] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.554079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.554113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.554375] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.554917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.554917] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1166.584859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.584859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.584859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.585012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.585098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.597328] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1166.805929] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.952895] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.953315] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.953315] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.953554] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.953698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.953849] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port b204302a-9ec7-4755-9c52-da86b2682c47 not found, creating... [ 1166.954121] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.954280] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.954395] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.954609] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.954743] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.955152] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.955262] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.955315] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.955511] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.955643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.955779] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: b204302a-9ec7-4755-9c52-da86b2682c47 is going to be created. [ 1166.976449] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.976653] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.976818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.977122] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.977359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.977578] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.308611] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.681083] env[65319]: INFO networking_nsxv3.common.synchronization [req-f66b3a1c-0699-4c7f-a401-5b8b0d63de60 req-c24e8854-c26c-4acc-af2c-928a83f50d64 service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 1167.681282] env[65319]: INFO networking_nsxv3.common.synchronization [req-f66b3a1c-0699-4c7f-a401-5b8b0d63de60 req-c24e8854-c26c-4acc-af2c-928a83f50d64 service nova] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1167.681460] env[65319]: INFO networking_nsxv3.common.synchronization [req-f66b3a1c-0699-4c7f-a401-5b8b0d63de60 req-c24e8854-c26c-4acc-af2c-928a83f50d64 service nova] Enqueued Resource ID: b204302a-9ec7-4755-9c52-da86b2682c47 with Priority: HIGHEST for action port [ 1167.681965] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_rules [ 1167.682113] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1167.682212] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204302a-9ec7-4755-9c52-da86b2682c47 with Priority: HIGHEST for action port [ 1167.682497] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.682613] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.682682] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.682890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.683091] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.683861] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.683956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684169] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-b204302a-9ec7-4755-9c52-da86b2682c47 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.684325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.684525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.684602] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b204302a-9ec7-4755-9c52-da86b2682c47',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.811045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.811045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.811045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.811045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.811412] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.811412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1167.846332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.846547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.846547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.846791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.846971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.858615] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1167.955809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: SUCCESS [ 1167.956154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.980850] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc in Status: SUCCESS [ 1167.980991] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc deletion is rescheduled due to dependency. [ 1167.981105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.186564] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.186783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.186836] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b204302a-9ec7-4755-9c52-da86b2682c47 with status ACTIVE [ 1168.186994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.187120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.187186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.187410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.187500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.187677] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.187773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.187834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.187997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.188089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.188273] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.188363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.188422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.188595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.188675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.188762] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b204302a-9ec7-4755-9c52-da86b2682c47 is going to be updated. [ 1168.209701] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.209907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.209953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.210156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.210296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.210476] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b204302a-9ec7-4755-9c52-da86b2682c47" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.610616] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1168.610808] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa deletion is rescheduled due to dependency. [ 1168.610930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.611186] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.611386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.611577] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.611698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.611766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.611928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.612019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.612120] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.114953] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.616907] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.869767] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.871482] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.871482] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.872027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.872027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.119603] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.119979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.119979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.120105] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.120150] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.120227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1170.154997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.155390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.155390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.155490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.155602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.168808] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1170.374843] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.374843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.374843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.375379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.375379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.375379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.375533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.375618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.375687] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.375794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.375896] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.375995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.376073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.376223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.376362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.376466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.376528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.376661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.376743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.376847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.376942] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.879217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95d83bf-87be-46fb-a121-6221d6adfa83: rpc.has_security_group_logging(os_id): False [ 1170.909071] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909071] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909071] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.909730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.909730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909730] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1170.990979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.991719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.991719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.991719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.991881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.014499] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1172.181098] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1172.181493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.181801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.182076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.182410] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.182542] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.182601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.182811] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.183109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.183109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.183109] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.683832] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.684088] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1172.685378] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.027505] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1173.027505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.189122] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa: rpc.has_security_group_logging(os_id): False [ 1173.207352] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.207544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.207622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.207858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.207956] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.208240] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.208348] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.208422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.208592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.208671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.209142] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1173.291341] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.291533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.291602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.291886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.292110] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.305301] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1175.321568] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1175.321568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.443132] env[65319]: INFO networking_nsxv3.common.synchronization [req-2705a8fd-c2e9-463b-9b8d-0bc4bea626bf req-0155d955-5799-427f-8bd6-d67e9aa874f8 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1175.443600] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1175.443935] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.444235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.444340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.444630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.444820] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.444932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.445007] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.445193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.445280] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.445375] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.871590] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.871733] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.872620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.872620] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.872810] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.873077] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.873138] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.873317] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.873510] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.873688] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.873784] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.873897] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.874022] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.874130] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.874256] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.874366] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.894771] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.894947] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.895100] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.895279] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-578" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.895604] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-4e028bfb-f8c1-4961-addb-ffada588255f taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.895770] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.895889] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.896260] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.896402] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e028bfb-f8c1-4961-addb-ffada588255f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.946968] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.399432] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.399818] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.400425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.400425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.400681] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.400681] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 4e028bfb-f8c1-4961-addb-ffada588255f not found, creating... [ 1176.401030] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.401204] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.401349] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.401643] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.401840] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.402278] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.402566] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.402658] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.402951] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.403121] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.403292] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 4e028bfb-f8c1-4961-addb-ffada588255f is going to be created. [ 1176.428126] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.428339] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.428462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.428743] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.429015] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.429277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.449710] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.955982] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.955982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.955982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.955982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.955982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.955982] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1176.982940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.983118] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.983170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.983373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.983521] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.992816] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1177.157705] env[65319]: INFO networking_nsxv3.common.synchronization [req-2705a8fd-c2e9-463b-9b8d-0bc4bea626bf req-0a15f08f-de22-4347-a4df-13600a0d2cbb service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1177.157899] env[65319]: INFO networking_nsxv3.common.synchronization [req-2705a8fd-c2e9-463b-9b8d-0bc4bea626bf req-0a15f08f-de22-4347-a4df-13600a0d2cbb service nova] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1177.158045] env[65319]: INFO networking_nsxv3.common.synchronization [req-2705a8fd-c2e9-463b-9b8d-0bc4bea626bf req-0a15f08f-de22-4347-a4df-13600a0d2cbb service nova] Enqueued Resource ID: 4e028bfb-f8c1-4961-addb-ffada588255f with Priority: HIGHEST for action port [ 1177.158577] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_rules [ 1177.158720] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1177.158830] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e028bfb-f8c1-4961-addb-ffada588255f with Priority: HIGHEST for action port [ 1177.159166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.159319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.159390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.159628] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.159716] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.160611] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.161034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.161034] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e028bfb-f8c1-4961-addb-ffada588255f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.161034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.161034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.161034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.161034] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e028bfb-f8c1-4961-addb-ffada588255f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.663783] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.663783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.663783] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e028bfb-f8c1-4961-addb-ffada588255f with status ACTIVE [ 1177.664254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.664254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.664254] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.664632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.664632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.665014] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.665014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.665116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.665349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.665477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.665720] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.665862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.666193] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.666345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.666514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.666694] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e028bfb-f8c1-4961-addb-ffada588255f is going to be updated. [ 1177.704239] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.705027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.705027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.705027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.705027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.705027] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e028bfb-f8c1-4961-addb-ffada588255f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.002551] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1179.002915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.002915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.003173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.003364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.003509] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.003579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.003741] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.003822] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.003918] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.353329] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.353514] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.353647] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.354046] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.354190] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.354351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.354494] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.354698] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.354842] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.355119] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.355275] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.355394] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.355639] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.356254] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.356395] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.356566] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.375927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.376279] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.376364] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.376512] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.376821] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-31264ab6-c4c9-40b2-b24b-3679a50760d4 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.377279] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.377279] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.377608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.377752] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31264ab6-c4c9-40b2-b24b-3679a50760d4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.506048] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.880888] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.881161] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.881291] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.881571] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.881938] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.881938] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 31264ab6-c4c9-40b2-b24b-3679a50760d4 not found, creating... [ 1179.882159] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.882322] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.882435] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.882645] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.882777] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.883073] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.883233] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.883341] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.883565] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.883702] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.883838] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 is going to be created. [ 1179.904540] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.904757] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.904877] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.905189] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.905426] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.905636] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.009459] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.512363] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.512518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.512592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.512807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.512898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.512998] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1180.541843] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.542017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.542080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.542291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.542442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.558837] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1180.610662] env[65319]: INFO networking_nsxv3.common.synchronization [req-d1ac3afa-a9f0-4907-8128-23445dabef70 req-aa7488a1-7a86-4150-8f1e-6099922168bd service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1180.610843] env[65319]: INFO networking_nsxv3.common.synchronization [req-d1ac3afa-a9f0-4907-8128-23445dabef70 req-aa7488a1-7a86-4150-8f1e-6099922168bd service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1180.611118] env[65319]: INFO networking_nsxv3.common.synchronization [req-d1ac3afa-a9f0-4907-8128-23445dabef70 req-aa7488a1-7a86-4150-8f1e-6099922168bd service nova] Enqueued Resource ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 with Priority: HIGHEST for action port [ 1180.611670] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1180.611722] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1180.611811] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 with Priority: HIGHEST for action port [ 1180.612084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.612204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.612272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.612516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.612553] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.613383] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.613496] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.614145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.614145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.614145] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.614145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.614145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.614145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.614446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.614446] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.615044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-31264ab6-c4c9-40b2-b24b-3679a50760d4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.615156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.615438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.615438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.615438] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31264ab6-c4c9-40b2-b24b-3679a50760d4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.117818] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.119192] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.119302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.119456] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31264ab6-c4c9-40b2-b24b-3679a50760d4 with status ACTIVE [ 1181.119613] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.119744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.119773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.119972] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.120245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.120306] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.120415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.120484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.120676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.120760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.120969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.121954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.122046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.122484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.122612] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.122711] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 is going to be updated. [ 1181.145506] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.145704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.145704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.145895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.146051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.146215] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.625287] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.127968] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.127968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.128654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.128654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.128654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.128654] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1182.181269] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.181471] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.181569] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.181837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.182038] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.196319] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1182.568894] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1182.569175] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.569363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.569594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.569848] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.570029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.570225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.570515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.570672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.570732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.570787] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.073977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.073977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.073977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.073977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.074633] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.074750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.074816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.075022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.075124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.075245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.075435] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.075561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.075637] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.075808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.075958] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.076111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.076192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.076370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.076467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.076581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.076676] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.579029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd0a2e0b-8eec-4c51-b1ed-6efc9f219567: rpc.has_security_group_logging(os_id): False [ 1183.597707] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.597929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.597929] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.598173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.598264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.598491] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.598631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.598707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.598836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.598917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.599170] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.599286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.599363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.599468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.599541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.599723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.599829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.599885] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.600032] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.600119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.600607] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1183.679844] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.680089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.680185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.680501] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.680672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.694945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1184.205711] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1184.205913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.206114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.206339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.206534] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.206651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.206715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.206870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.206949] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.207069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.207183] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.709645] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.710029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.710029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.710197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.710395] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.710525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.710597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.710790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.710891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.711016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.711189] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.711303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.711368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.711548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.711705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.711808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.711870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.712046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.712141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.712287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.712345] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.214535] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd590ec-aafc-4836-92d2-a1ad91f3849f: rpc.has_security_group_logging(os_id): False [ 1185.232252] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.232448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.232602] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.232829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.232967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.233153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.233255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.233322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.233463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.233538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.233725] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.233820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.233884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.234051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.234133] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.234315] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.234410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.234470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.234607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.234679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.234773] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1185.294494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.294740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.294740] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.295067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.295067] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.307106] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1185.612745] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.612745] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1185.711703] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1185.712120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.323582] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1187.323993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.614075] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.614455] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1191.754536] env[65319]: INFO networking_nsxv3.common.synchronization [req-b74ea542-663a-4808-96ab-283c17a14a99 req-0c0c675f-a38f-4c95-8d34-89e2f2b267f3 tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1191.754860] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1191.754994] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.755131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.755198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.755399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.755556] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.755677] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.755713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.755845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.755927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.756027] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.258374] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.760654] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.263927] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.264178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.264178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.264384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.264479] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.264582] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1193.297658] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.297842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.297889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.298083] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.298232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.307706] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1195.319496] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1195.319836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.525320] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.525610] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.525697] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.525963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.526240] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.526400] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.526517] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.526742] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.526888] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.527119] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.527233] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.527364] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.527476] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.527587] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.527692] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.527839] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.547196] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.547406] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1196.547588] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.547763] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-225" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.548083] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-31264ab6-c4c9-40b2-b24b-3679a50760d4 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.548253] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.548374] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.548623] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.548755] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31264ab6-c4c9-40b2-b24b-3679a50760d4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.755654] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.755834] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1197.050854] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.051071] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.051240] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.051549] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.051657] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.051921] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.052141] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.052266] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.052492] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.052636] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.052916] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.053084] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.053205] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.053424] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.053586] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.053729] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 is going to be updated. [ 1197.074771] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.074771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.074771] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.075041] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.075247] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.075467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [req-202a411b-e824-4f35-b7b8-9ec1cae357c6 req-64e94599-1694-4d7b-91a5-e35943b30ad2 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [req-202a411b-e824-4f35-b7b8-9ec1cae357c6 req-64e94599-1694-4d7b-91a5-e35943b30ad2 service nova] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [req-202a411b-e824-4f35-b7b8-9ec1cae357c6 req-64e94599-1694-4d7b-91a5-e35943b30ad2 service nova] Enqueued Resource ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 with Priority: HIGHEST for action port [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_rules [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1197.778594] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 with Priority: HIGHEST for action port [ 1197.778594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.778594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.779154] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.779649] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.779826] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.781277] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.782317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.782401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.782553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.782727] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.782836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.782902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.783074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.783162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.783257] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.784074] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-31264ab6-c4c9-40b2-b24b-3679a50760d4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.784146] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.784223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.784771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.784771] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31264ab6-c4c9-40b2-b24b-3679a50760d4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.180265] env[65319]: INFO networking_nsxv3.common.synchronization [req-280b16b7-812c-49d0-9c79-e9739b9f3075 req-3c58af3e-3509-4288-bf0a-44c90201d5fd tempest-ServersTestJSON-1423340870 tempest-ServersTestJSON-1423340870-project-member] Enqueued Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1198.180265] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 with Priority: HIGHEST for action security_group_members [ 1198.180572] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.180979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.181079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.181241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.181406] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.181693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.181693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.181782] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.181857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.181973] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd0a2e0b-8eec-4c51-b1ed-6efc9f219567',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.286047] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.286047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.286296] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.287244] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31264ab6-c4c9-40b2-b24b-3679a50760d4 with status ACTIVE [ 1198.287527] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.287666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.287760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.287990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.288098] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.288310] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.288439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.288508] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.288685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.289453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.289453] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.289453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.289453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.289453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.289453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.289453] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31264ab6-c4c9-40b2-b24b-3679a50760d4 is going to be updated. [ 1198.309954] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.310226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.310226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.310381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.310580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.310795] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31264ab6-c4c9-40b2-b24b-3679a50760d4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.684385] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.684385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.684385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.684670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.684773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.685113] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.685278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.685378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.685600] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.685730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.685880] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 is going to be updated. [ 1198.715758] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.716015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.716015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.716180] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.716329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.725882] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: IN_PROGRESS for 2s [ 1198.791847] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.294530] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.294530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.294715] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.294862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.296202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.296202] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1199.322380] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.322528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.322603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.322808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.322957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.332107] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1200.736813] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 in Status: SUCCESS [ 1200.737177] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd0a2e0b-8eec-4c51-b1ed-6efc9f219567 deletion is rescheduled due to dependency. [ 1200.737177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd0a2e0b-8eec-4c51-b1ed-6efc9f219567" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.344035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1201.344264] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.344439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.344668] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.344862] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.344974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.345048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.345204] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.345282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.345369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.345459] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.849436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.849827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.849827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.849827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.850052] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.850147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.850216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.850322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.850410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.850504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.850689] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.850788] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.851103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.851103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.851244] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.851244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.851339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.851401] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.851469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.851599] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.851648] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.189226] env[65319]: INFO networking_nsxv3.common.synchronization [req-3648820f-a931-41c4-9bff-ce39b2d801ae req-0a42d362-5b4f-426c-9c03-c4f9f0b79d6a tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1202.190454] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1202.190454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.190454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.190709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.190709] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.190873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.190979] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.191179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.191352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.191444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.191540] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.355064] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd590ec-aafc-4836-92d2-a1ad91f3849f: rpc.has_security_group_logging(os_id): False [ 1202.377572] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.377722] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.377796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.378046] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.378399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.378399] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.378533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.378568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.378725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.378825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.379084] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.379178] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.379249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.379452] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.379518] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.379704] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.379821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.379879] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.380035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.380111] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.380209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1202.458823] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.459048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.459048] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.459262] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.459448] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.473761] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1202.678600] env[65319]: INFO networking_nsxv3.common.synchronization [req-d659e604-a1b8-4d94-873e-7d6c2e057623 req-e108e94b-8fbe-44cf-a33a-00902643bcae tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1202.679120] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGHEST for action security_group_members [ 1202.679485] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.679608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.679676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.679940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.680602] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.680746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.680817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.680990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.681096] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.681211] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.694044] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.694203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.694261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.694457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.694551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.694738] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.694836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.694900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.695061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.695137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.695223] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1202.733232] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.733424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.733468] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.733658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.733806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.747549] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1203.183484] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.183484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.183484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.184053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.184454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.184454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.184671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.184671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.185131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.185131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.185131] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 is going to be updated. [ 1203.214291] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.214449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.214519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.214732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.214873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.225953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: IN_PROGRESS for 2s [ 1204.487531] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1204.487798] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.755357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 4s [ 1205.236557] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 in Status: SUCCESS [ 1205.236733] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 deletion is rescheduled due to dependency. [ 1205.236849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.806523] env[65319]: INFO networking_nsxv3.common.synchronization [req-198b4239-b417-40bd-8133-efc36b7f6764 req-35127852-3d45-4bad-9ba2-f332eaca2acd tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1205.807058] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1205.807544] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.807658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.078637] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.078859] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.079039] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.079373] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.079633] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.080057] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.080228] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.080509] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.080678] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.080888] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.081013] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.081125] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.081233] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.081343] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.081447] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.081615] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.100343] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.100533] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1206.100702] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.100882] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-664" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.101212] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-19610ccf-1057-4a1b-bfda-dc061d94e0b8 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.101385] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.101506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.101854] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.101981] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19610ccf-1057-4a1b-bfda-dc061d94e0b8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.604769] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.604991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.605157] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.605571] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.605833] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.606034] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 19610ccf-1057-4a1b-bfda-dc061d94e0b8 not found, creating... [ 1206.606303] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.606462] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.606578] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.606891] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.607141] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.607643] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.607890] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.608106] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.608336] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.608478] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.608618] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 19610ccf-1057-4a1b-bfda-dc061d94e0b8 is going to be created. [ 1206.627997] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.628211] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.628308] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.628546] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.628784] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.628991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.765356] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1206.765636] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1206.765786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.765952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.766195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.766376] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.766503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.766575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.766702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.766774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.766901] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.268877] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.269156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.269156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.269346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.269440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.269700] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.269805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.269872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.270040] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.270121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.270210] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1207.297973] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.297973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.297973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.298459] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.298655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.309194] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [req-198b4239-b417-40bd-8133-efc36b7f6764 req-7d8e6683-6dce-48c9-9589-c15acfdc42d7 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [req-198b4239-b417-40bd-8133-efc36b7f6764 req-7d8e6683-6dce-48c9-9589-c15acfdc42d7 service nova] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [req-198b4239-b417-40bd-8133-efc36b7f6764 req-7d8e6683-6dce-48c9-9589-c15acfdc42d7 service nova] Enqueued Resource ID: 19610ccf-1057-4a1b-bfda-dc061d94e0b8 with Priority: HIGHEST for action port [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_rules [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1207.343027] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19610ccf-1057-4a1b-bfda-dc061d94e0b8 with Priority: HIGHEST for action port [ 1207.343721] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.344092] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.344269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.344707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.345023] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.345924] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.348100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.348100] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-19610ccf-1057-4a1b-bfda-dc061d94e0b8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.348100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.348100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.348100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.348100] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19610ccf-1057-4a1b-bfda-dc061d94e0b8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.849663] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.849663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.849864] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19610ccf-1057-4a1b-bfda-dc061d94e0b8 with status ACTIVE [ 1207.850088] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.850274] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.850343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.850596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.851449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.851449] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.851449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.851449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.851449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.851449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.851721] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.851721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.851809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.851939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.852033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.852120] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19610ccf-1057-4a1b-bfda-dc061d94e0b8 is going to be updated. [ 1207.878657] env[65319]: INFO networking_nsxv3.common.synchronization [None req-46d68907-c19f-4479-9ec4-0b74f7e99d2a tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1207.879269] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1207.879269] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.879630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.879630] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.879734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.879770] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.901420] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.901576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.901625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.905020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.905020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.905020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19610ccf-1057-4a1b-bfda-dc061d94e0b8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.975207] env[65319]: INFO networking_nsxv3.common.synchronization [None req-bf8fba4b-c237-471b-81d0-d624688bc5b7 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1207.975573] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1207.975920] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.976081] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.402218] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.402485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.402485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.402834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.402909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.403037] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 already deleted. [ 1208.403130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.403283] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.403458] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.403548] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.925674] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.925674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.925828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.925924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.925991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.926105] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 already deleted. [ 1208.926189] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.321162] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1209.321353] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1209.321470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.321638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.321955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.322181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.322309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.322373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.322568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.322658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.322748] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.824951] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.327471] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.829778] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.830123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.830123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.830244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.830334] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.830432] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1210.860857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.861066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.861134] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.861321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.861469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.870660] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1212.882366] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1212.882747] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.882797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.883084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.883333] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.883470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.883544] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.883721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.883806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.883906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.884014] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.976370] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.976552] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1213.385979] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.386249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.386249] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.386522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.386756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.386874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.386976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.387155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.387155] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.387255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.387436] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.387530] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.387587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.387786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.387938] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.388104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.388162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.388287] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.388402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.388465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.388534] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.554889] env[65319]: INFO networking_nsxv3.common.synchronization [req-82ad1dc1-b3be-4990-8a89-6d5881cff4dd req-267c9893-136c-49a4-8edb-8ad22903cecc tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1213.556059] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1213.556059] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.556059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.556059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.556775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.556775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.556775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.556775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.556775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.556775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.557196] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.875440] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.875634] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.875810] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.876154] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.876430] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.876591] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.876708] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.876958] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.877169] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.877450] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.877586] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1213.877702] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1213.877837] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1213.877954] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.878072] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1213.878209] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1213.891099] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95d83bf-87be-46fb-a121-6221d6adfa83: rpc.has_security_group_logging(os_id): False [ 1213.903571] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1213.903839] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1213.903940] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1213.904066] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-764" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.904400] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-622f604c-98bb-45b3-8fc6-951a9b12d9ea taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.904591] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.904712] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.905055] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.905199] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622f604c-98bb-45b3-8fc6-951a9b12d9ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.913057] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.913241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.913241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.913807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.913807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.913807] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.913807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.914430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.914430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.914430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.914430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.914567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.914567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.914939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.914939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.914939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.915112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.915112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.915261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.915382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.915855] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1214.027362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.027611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.027611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.027831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.027985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.044624] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1214.058836] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.058999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.059055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.059252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.059346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.059539] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.059650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.059719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.059875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.059952] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.060046] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 already deleted. [ 1214.060129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.139221] env[65319]: INFO networking_nsxv3.common.synchronization [req-b8d156ab-6c6c-486e-ade9-25be49186eb6 req-cdf70b1a-5b6b-4a2d-b1a7-dfd45843b107 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1214.139808] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1214.140143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.140272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.140340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.140539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.141166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.141277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.141344] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.141522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.141607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.141724] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.408159] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.411020] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 622f604c-98bb-45b3-8fc6-951a9b12d9ea not found, creating... [ 1214.411020] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.411020] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.411469] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.411469] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.412292] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.412655] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.412913] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.413199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 622f604c-98bb-45b3-8fc6-951a9b12d9ea is going to be created. [ 1214.434683] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.434683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.434683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.434683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.434683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.434683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.644210] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.145551] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.162502] env[65319]: INFO networking_nsxv3.common.synchronization [req-82ad1dc1-b3be-4990-8a89-6d5881cff4dd req-39789c34-b273-4528-9446-4c1c4fbf58a2 service nova] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1215.162692] env[65319]: INFO networking_nsxv3.common.synchronization [req-82ad1dc1-b3be-4990-8a89-6d5881cff4dd req-39789c34-b273-4528-9446-4c1c4fbf58a2 service nova] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1215.162830] env[65319]: INFO networking_nsxv3.common.synchronization [req-82ad1dc1-b3be-4990-8a89-6d5881cff4dd req-39789c34-b273-4528-9446-4c1c4fbf58a2 service nova] Enqueued Resource ID: 622f604c-98bb-45b3-8fc6-951a9b12d9ea with Priority: HIGHEST for action port [ 1215.163345] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_rules [ 1215.163580] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1215.163580] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622f604c-98bb-45b3-8fc6-951a9b12d9ea with Priority: HIGHEST for action port [ 1215.163835] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.163984] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.166404] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.166404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.166404] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.166404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.166894] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.167487] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-622f604c-98bb-45b3-8fc6-951a9b12d9ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.167565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.167601] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.167785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.167871] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622f604c-98bb-45b3-8fc6-951a9b12d9ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.648285] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.648533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.648533] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.648725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.648815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.649235] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be updated. [ 1215.670055] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.670269] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.673668] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.674669] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 622f604c-98bb-45b3-8fc6-951a9b12d9ea with status ACTIVE [ 1215.674904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.675044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.675107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.675333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.675472] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.675729] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.675861] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.675936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.676114] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.676373] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.677030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.677030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.677030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.677030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.677387] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.677387] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 622f604c-98bb-45b3-8fc6-951a9b12d9ea is going to be updated. [ 1215.679466] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.679575] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.679676] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.679836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.679991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.691771] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1215.701166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.701369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.701369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.701969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.702130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.702284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-622f604c-98bb-45b3-8fc6-951a9b12d9ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.058943] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1216.059188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.181757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.685668] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.685760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.685868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.686218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.686809] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.686809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 is going to be created. [ 1216.710489] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.710489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.710719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.710805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.711097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.720713] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: UNINITIALIZED for 2s [ 1217.705350] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1217.705790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.731439] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: UNINITIALIZED for 4s [ 1219.165812] env[65319]: INFO networking_nsxv3.common.synchronization [req-91d68e43-9557-4b92-8665-bf63154d0e9c req-6da17f56-7eab-4894-894f-ee1d382be2e6 tempest-ServerDiskConfigTestJSON-567552875 tempest-ServerDiskConfigTestJSON-567552875-project-member] Enqueued Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1219.166594] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95d83bf-87be-46fb-a121-6221d6adfa83 with Priority: HIGHEST for action security_group_members [ 1219.166867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95d83bf-87be-46fb-a121-6221d6adfa83 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.167014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.170842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.171176] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.171440] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.172036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.172936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.173199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.173351] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.173507] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95d83bf-87be-46fb-a121-6221d6adfa83',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.675899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.676172] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.676284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.676582] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.676719] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.677013] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.677177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.677268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.677698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.677698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.677819] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 is going to be updated. [ 1219.707987] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.708181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.708225] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.708406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.708539] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.717898] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: IN_PROGRESS for 2s [ 1220.741639] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: SUCCESS [ 1220.741958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.742165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.742428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.742646] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.742850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.742850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.743142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.743142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.743224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.743254] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.245350] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.729087] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95d83bf-87be-46fb-a121-6221d6adfa83 in Status: SUCCESS [ 1221.729087] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95d83bf-87be-46fb-a121-6221d6adfa83 deletion is rescheduled due to dependency. [ 1221.729087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95d83bf-87be-46fb-a121-6221d6adfa83" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.747566] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9729f66f-3933-4e9d-9ee7-82962d006fe2: rpc.has_security_group_logging(os_id): False [ 1221.771312] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.771510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.771556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.771763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.771855] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.772162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.772270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.772330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.772497] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.772573] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.772663] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 is going to be created. [ 1221.835615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.835775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.835849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.836085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.836270] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.847991] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: IN_PROGRESS for 2s [ 1221.962247] env[65319]: INFO networking_nsxv3.common.synchronization [req-3d54e5fb-e6e7-4ea3-8367-5f9eb141901e req-bd22d7ab-f53a-4243-915f-92598714b6fb tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1221.962821] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGHEST for action security_group_members [ 1221.963165] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.963289] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.963358] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.963561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.963727] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.963844] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.963997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.964179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.964286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.964369] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.467382] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.467699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.467868] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.468181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.468409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.468590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.468699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.468765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.468931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.469023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.469111] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be updated. [ 1222.496587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.496587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.496587] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.496853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.496853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.505793] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: IN_PROGRESS for 2s [ 1223.860295] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: SUCCESS [ 1223.860561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.517579] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47634945-8e30-46dc-82da-93cd5685cbc3 in Status: SUCCESS [ 1224.517807] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 deletion is rescheduled due to dependency. [ 1224.517927] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.002029] env[65319]: INFO networking_nsxv3.common.synchronization [None req-e11b5c64-b643-4eea-acd5-a12e1ba9aef7 tempest-AttachInterfacesTestJSON-725428953 tempest-AttachInterfacesTestJSON-725428953-project-member] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1226.002029] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGHEST for action security_group_members [ 1226.003049] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.003370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.003553] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.004042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.005023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.005023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.005023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.005023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.005023] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.005562] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.508500] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.508500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.508666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.508737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.508934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.509030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.509127] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.509196] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.509324] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.509398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.509482] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be updated. [ 1226.538684] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.538684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.538684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.538684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.538684] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.547309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: IN_PROGRESS for 2s [ 1227.794271] env[65319]: INFO networking_nsxv3.common.synchronization [None req-199e16f7-0ce5-4a21-b973-da26cbf080b5 None None] Enqueued Resource ID: 0de68067-d46d-4731-bd9c-bbfa935ee562 with Priority: HIGHEST for action port [ 1227.794271] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de68067-d46d-4731-bd9c-bbfa935ee562 with Priority: HIGHEST for action port [ 1227.794271] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de68067-d46d-4731-bd9c-bbfa935ee562 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.794271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de68067-d46d-4731-bd9c-bbfa935ee562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.794271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de68067-d46d-4731-bd9c-bbfa935ee562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.794271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de68067-d46d-4731-bd9c-bbfa935ee562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.794271] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de68067-d46d-4731-bd9c-bbfa935ee562',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.299321] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0de68067-d46d-4731-bd9c-bbfa935ee562 [ 1228.299543] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.299667] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.301925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.301925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.301925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.301925] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0de68067-d46d-4731-bd9c-bbfa935ee562 already deleted. [ 1228.301925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de68067-d46d-4731-bd9c-bbfa935ee562" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.562217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f in Status: SUCCESS [ 1228.562217] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f deletion is rescheduled due to dependency. [ 1228.562217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.921217] env[65319]: INFO networking_nsxv3.common.synchronization [None req-133addd7-edc2-409e-9a2b-4d087b4e9010 None None] Enqueued Resource ID: 2fe51241-94e5-41a9-8d7f-c225becf6edb with Priority: HIGHEST for action port [ 1229.921935] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe51241-94e5-41a9-8d7f-c225becf6edb with Priority: HIGHEST for action port [ 1229.922407] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe51241-94e5-41a9-8d7f-c225becf6edb taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.922651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe51241-94e5-41a9-8d7f-c225becf6edb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.922731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe51241-94e5-41a9-8d7f-c225becf6edb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.923116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe51241-94e5-41a9-8d7f-c225becf6edb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.923244] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe51241-94e5-41a9-8d7f-c225becf6edb',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.425482] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fe51241-94e5-41a9-8d7f-c225becf6edb [ 1230.425761] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.425939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.426160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.426399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.426535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.426628] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fe51241-94e5-41a9-8d7f-c225becf6edb already deleted. [ 1230.426721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe51241-94e5-41a9-8d7f-c225becf6edb" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.614845] env[65319]: INFO networking_nsxv3.common.synchronization [None req-74c4b2df-94e3-4cb9-ab4e-368a47dd773b None None] Enqueued Resource ID: ce6bd6c5-4e38-494c-9fc8-24f548259e80 with Priority: HIGHEST for action port [ 1230.615755] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce6bd6c5-4e38-494c-9fc8-24f548259e80 with Priority: HIGHEST for action port [ 1230.615755] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce6bd6c5-4e38-494c-9fc8-24f548259e80 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.616328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce6bd6c5-4e38-494c-9fc8-24f548259e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.616328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce6bd6c5-4e38-494c-9fc8-24f548259e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.616328] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce6bd6c5-4e38-494c-9fc8-24f548259e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.616328] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce6bd6c5-4e38-494c-9fc8-24f548259e80',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.118437] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce6bd6c5-4e38-494c-9fc8-24f548259e80 [ 1231.118746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.118975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.119184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.119446] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.120874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.120874] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce6bd6c5-4e38-494c-9fc8-24f548259e80 already deleted. [ 1231.120874] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce6bd6c5-4e38-494c-9fc8-24f548259e80" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.244983] env[65319]: INFO networking_nsxv3.common.synchronization [req-99adb55f-a7c7-488e-98da-fdc8d30d112c req-216b0da8-07d0-47cf-89c6-f0773b12891c tempest-ServerActionsTestJSON-616248779 tempest-ServerActionsTestJSON-616248779-project-member] Enqueued Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1231.245570] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa with Priority: HIGHEST for action security_group_members [ 1231.245916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.246631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.247346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.247566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.247779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.247833] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.247892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.248693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.248693] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.248693] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.750970] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.750970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.751117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.752030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.752030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.752030] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.752030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.752405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.752405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.752517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.753664] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa is going to be updated. [ 1231.786870] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.787101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.787210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.787774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.787774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.796983] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: IN_PROGRESS for 2s [ 1232.654599] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7cdc2597-c96b-4537-86d1-00dd3ee42624 None None] Enqueued Resource ID: 448eb5a8-afdb-4db8-b687-b985ba83e966 with Priority: HIGHEST for action port [ 1232.655199] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448eb5a8-afdb-4db8-b687-b985ba83e966 with Priority: HIGHEST for action port [ 1232.655818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-448eb5a8-afdb-4db8-b687-b985ba83e966 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.655818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-448eb5a8-afdb-4db8-b687-b985ba83e966" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.655818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-448eb5a8-afdb-4db8-b687-b985ba83e966" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.656022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-448eb5a8-afdb-4db8-b687-b985ba83e966" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.656780] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448eb5a8-afdb-4db8-b687-b985ba83e966',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.159065] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 448eb5a8-afdb-4db8-b687-b985ba83e966 [ 1233.159397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.159634] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.159743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.160091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.160218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.160339] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:448eb5a8-afdb-4db8-b687-b985ba83e966 already deleted. [ 1233.160431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-448eb5a8-afdb-4db8-b687-b985ba83e966" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.807809] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa in Status: SUCCESS [ 1233.808243] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa deletion is rescheduled due to dependency. [ 1233.808243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.216787] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3d50e33-df26-44c5-8c5d-1592e1262100 req-d41f2659-498f-4626-8000-efd3d6dfe3d4 tempest-ServerMetadataNegativeTestJSON-763396256 tempest-ServerMetadataNegativeTestJSON-763396256-project-member] Enqueued Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1234.217345] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1234.217654] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.217776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.217843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.218754] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.218940] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.219070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.219139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.219321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.219408] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.219506] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.520978] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.522028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-772" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.522028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-772" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.522028] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-772" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.522028] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.522281] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.522281] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.522425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.522572] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.522785] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.522901] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.523022] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.523133] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.523419] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.523419] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.523477] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.542415] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.542620] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1234.542786] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.542974] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-772" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.543311] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-244a1b7f-a690-433d-bb03-b032328e03f5 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.543486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.543629] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.544010] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.544167] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244a1b7f-a690-433d-bb03-b032328e03f5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.722414] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.722614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.722614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.722805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.722895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.723184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.723284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.723349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.723500] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.723576] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.723661] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 already deleted. [ 1234.723739] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.046574] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.047045] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.047045] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.047196] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.047345] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.047501] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 244a1b7f-a690-433d-bb03-b032328e03f5 not found, creating... [ 1235.047761] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.047949] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.048093] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.048319] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.048453] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.048741] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.048897] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.049050] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.049227] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.049359] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.049498] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 244a1b7f-a690-433d-bb03-b032328e03f5 is going to be created. [ 1235.069408] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.069622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.069790] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.070158] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.070390] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.070608] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.771629] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3d50e33-df26-44c5-8c5d-1592e1262100 req-49eabb95-574c-44ae-a693-bdeaa1200060 service nova] Enqueued Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_rules [ 1235.772174] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3d50e33-df26-44c5-8c5d-1592e1262100 req-49eabb95-574c-44ae-a693-bdeaa1200060 service nova] Enqueued Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1235.772253] env[65319]: INFO networking_nsxv3.common.synchronization [req-c3d50e33-df26-44c5-8c5d-1592e1262100 req-49eabb95-574c-44ae-a693-bdeaa1200060 service nova] Enqueued Resource ID: 244a1b7f-a690-433d-bb03-b032328e03f5 with Priority: HIGHEST for action port [ 1235.772849] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_rules [ 1235.772990] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1235.773131] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244a1b7f-a690-433d-bb03-b032328e03f5 with Priority: HIGHEST for action port [ 1235.773409] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.773648] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.773731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.773988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.774169] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.775590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.775590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.775590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.775590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.775590] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.775993] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.776958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.776958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.776958] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.776958] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.777292] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-244a1b7f-a690-433d-bb03-b032328e03f5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.777292] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.777380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.777512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.777585] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244a1b7f-a690-433d-bb03-b032328e03f5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.279624] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.280065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.280065] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 244a1b7f-a690-433d-bb03-b032328e03f5 with status ACTIVE [ 1236.280244] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.280363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.280430] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.280636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.280778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.281015] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.281156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.281228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.281421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.281526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.281734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.281858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.281977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.282117] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.282195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.282281] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 244a1b7f-a690-433d-bb03-b032328e03f5 is going to be updated. [ 1236.283381] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.308917] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.308917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.308917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.308917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.308917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.308917] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244a1b7f-a690-433d-bb03-b032328e03f5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.786070] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.288640] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.289104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.289104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.289104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.289238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.289273] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 is going to be created. [ 1237.315541] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.315541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.315541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.315772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.315863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.328870] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: UNINITIALIZED for 2s [ 1238.090860] env[65319]: INFO networking_nsxv3.common.synchronization [req-4d05e5d1-d181-4623-a4c0-a4ed58fec6bb req-329189da-24ea-4994-bedc-d9c6210ac1da tempest-ServerAddressesTestJSON-1031770480 tempest-ServerAddressesTestJSON-1031770480-project-member] Enqueued Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1238.091700] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1238.092048] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.092197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.092277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.092552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.092715] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.092817] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.092891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.093036] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.093123] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.093215] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.433808] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-475 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.434172] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-475" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.434216] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-475" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.434560] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-475" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.435721] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.435721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.435721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.435721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.435721] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.435948] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.436016] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.436147] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.436281] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.436369] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1238.436497] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.436663] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.457584] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.457802] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1238.457989] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.458253] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-475" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.458578] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-bae383ff-175d-4fac-9248-982fa9fb4cb9 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.458755] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.458871] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.459201] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.459341] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bae383ff-175d-4fac-9248-982fa9fb4cb9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.595531] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.595531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.595663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.595881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.596054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.596259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.596417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.596785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.596785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.596864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.596897] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 already deleted. [ 1238.596991] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.962205] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.962437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.962437] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.962722] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.963067] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.963067] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port bae383ff-175d-4fac-9248-982fa9fb4cb9 not found, creating... [ 1238.963294] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.963451] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.963562] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.963954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.963954] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.964220] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.964377] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.964491] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.964692] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.964821] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.964954] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: bae383ff-175d-4fac-9248-982fa9fb4cb9 is going to be created. [ 1238.987540] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.987540] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.987540] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.987540] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.987814] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.987991] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.340092] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: SUCCESS [ 1239.340796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.340796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.340796] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.340969] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.341057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.341095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.341281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.341363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.341450] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.341541] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.556548] env[65319]: INFO networking_nsxv3.common.synchronization [None req-1b392acc-0d36-4405-bbf7-773859bc6087 None None] Enqueued Resource ID: 51a195d1-319a-4917-ba65-dff985f8913d with Priority: HIGHEST for action port [ 1239.557435] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51a195d1-319a-4917-ba65-dff985f8913d with Priority: HIGHEST for action port [ 1239.558166] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-51a195d1-319a-4917-ba65-dff985f8913d taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.558166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51a195d1-319a-4917-ba65-dff985f8913d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.558166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51a195d1-319a-4917-ba65-dff985f8913d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.558486] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51a195d1-319a-4917-ba65-dff985f8913d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.558850] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51a195d1-319a-4917-ba65-dff985f8913d',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [req-4d05e5d1-d181-4623-a4c0-a4ed58fec6bb req-18090919-7de5-4451-94c1-951b8941520a service nova] Enqueued Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_rules [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [req-4d05e5d1-d181-4623-a4c0-a4ed58fec6bb req-18090919-7de5-4451-94c1-951b8941520a service nova] Enqueued Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [req-4d05e5d1-d181-4623-a4c0-a4ed58fec6bb req-18090919-7de5-4451-94c1-951b8941520a service nova] Enqueued Resource ID: bae383ff-175d-4fac-9248-982fa9fb4cb9 with Priority: HIGHEST for action port [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_rules [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1239.673648] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae383ff-175d-4fac-9248-982fa9fb4cb9 with Priority: HIGHEST for action port [ 1239.674769] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.674769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.674769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.674769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.674769] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.675592] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.675853] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.675931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.676218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.676432] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.676657] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.676959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.676959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.676959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.677346] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.678070] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-bae383ff-175d-4fac-9248-982fa9fb4cb9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.680022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.680022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.680022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.680022] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bae383ff-175d-4fac-9248-982fa9fb4cb9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.845537] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.845849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.845976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.846380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.846583] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.846699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.846793] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.847022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.847121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.847211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.847381] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.847477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.847550] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.847751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.847904] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.847999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.848074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.848220] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.848300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.848383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.848510] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.060873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51a195d1-319a-4917-ba65-dff985f8913d [ 1240.061054] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.061256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.061256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.061485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.061584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.061708] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51a195d1-319a-4917-ba65-dff985f8913d already deleted. [ 1240.061794] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51a195d1-319a-4917-ba65-dff985f8913d" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.097812] env[65319]: INFO networking_nsxv3.common.synchronization [None req-75b2bb9b-72d4-4df6-861d-b98fb4e77114 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1240.098790] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1240.098790] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.098967] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.099079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.099271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.099384] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.180829] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.180957] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.181294] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.182256] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bae383ff-175d-4fac-9248-982fa9fb4cb9 with status ACTIVE [ 1240.182364] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.182552] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.182616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.184065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.184065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.184065] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.185205] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bae383ff-175d-4fac-9248-982fa9fb4cb9 is going to be updated. [ 1240.186787] env[65319]: INFO networking_nsxv3.common.synchronization [None req-bbe9fee4-2e8d-4a16-88d2-31584cc8fac5 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1240.187801] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1240.188117] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.188217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.207255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.207428] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.207538] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.207696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.207832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.207989] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bae383ff-175d-4fac-9248-982fa9fb4cb9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.352747] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d4f77cd-1627-4596-b51b-813b08ea21e4: rpc.has_security_group_logging(os_id): False [ 1240.373939] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.373939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.373939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.374244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.374244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.374362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.374469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.374535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.374703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.374776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.374972] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.375799] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.375799] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.376627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.376627] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 is going to be created. [ 1240.441020] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.441020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.441020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.441020] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.441314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.452896] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: IN_PROGRESS for 2s [ 1240.620256] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.620561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.620561] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.620699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.620765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.620869] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 already deleted. [ 1240.620953] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.621223] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.621352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.621440] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.687828] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.141565] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.141708] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.141779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.142022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.142106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.142201] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 already deleted. [ 1241.142282] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.193797] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.193797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.193797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.193797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.193797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.193797] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 is going to be created. [ 1241.216489] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.216489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.216704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.216915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.217140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.228244] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: UNINITIALIZED for 2s [ 1241.461663] env[65319]: INFO networking_nsxv3.common.synchronization [None req-37ffd540-57c7-4cc1-b1e8-081156d58520 None None] Enqueued Resource ID: 704ba1f6-dd4d-40c9-a2c7-caf81c88bde3 with Priority: HIGHEST for action port [ 1241.462309] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704ba1f6-dd4d-40c9-a2c7-caf81c88bde3 with Priority: HIGHEST for action port [ 1241.462571] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-704ba1f6-dd4d-40c9-a2c7-caf81c88bde3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.462764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704ba1f6-dd4d-40c9-a2c7-caf81c88bde3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.462846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704ba1f6-dd4d-40c9-a2c7-caf81c88bde3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.463149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704ba1f6-dd4d-40c9-a2c7-caf81c88bde3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.463259] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704ba1f6-dd4d-40c9-a2c7-caf81c88bde3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.965443] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 704ba1f6-dd4d-40c9-a2c7-caf81c88bde3 [ 1241.965443] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.965763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.965763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.965824] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.965996] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.965996] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:704ba1f6-dd4d-40c9-a2c7-caf81c88bde3 already deleted. [ 1241.966122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704ba1f6-dd4d-40c9-a2c7-caf81c88bde3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.466228] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: SUCCESS [ 1242.466565] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.239199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: SUCCESS [ 1243.239457] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.239641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.239878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.240126] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.240296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.240370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.240556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.240662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.240769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.240883] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.743707] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.744597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.744597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.744597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.744597] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.744597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.744597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.744971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.744971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.744971] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.745065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.745107] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.745149] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.746034] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.746034] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.746034] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.249175] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dace3c2b-1f26-48fa-aa8e-522105a27e45: rpc.has_security_group_logging(os_id): False [ 1244.270494] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.270658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.270721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.270918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.271016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.271282] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.271389] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.271429] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.271581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.271658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.271831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.271928] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.271990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.272143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.272217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.272402] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.272495] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.272556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.272692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.272766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.272852] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 is going to be created. [ 1244.333398] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.333594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.333663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.333862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.334109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.346778] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: IN_PROGRESS for 2s [ 1246.131821] env[65319]: INFO networking_nsxv3.common.synchronization [req-984cb8a6-d93b-461e-bd97-16c9979e92dd req-64603627-3ba4-4d42-8b97-1614e889cb91 tempest-ServerMetadataNegativeTestJSON-763396256 tempest-ServerMetadataNegativeTestJSON-763396256-project-member] Enqueued Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1246.132389] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGHEST for action security_group_members [ 1246.132705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.132834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.132903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.133279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.133454] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.133627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.133701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.133867] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.134147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.134147] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.360690] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: SUCCESS [ 1246.360690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.514699] env[65319]: INFO networking_nsxv3.common.synchronization [req-a45eb84d-f96a-4b7a-b838-f5a27680284b req-9bd43fb7-c76a-4956-871e-91811e47ea50 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1246.515364] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1246.515769] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.515913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.515974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.516257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.516430] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.516532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.516594] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.516743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.516829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.516923] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.636064] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.636237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.636397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.636673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.636781] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.636977] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.637091] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.637153] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.637338] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.637419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.637507] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 is going to be updated. [ 1246.666309] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.666503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.666746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.666857] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.666998] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.677916] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: IN_PROGRESS for 2s [ 1246.835395] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.835683] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.835862] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.836336] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.836723] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.836953] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.837137] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.837448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.837649] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.837931] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.838122] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.838478] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.838689] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.838902] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.839053] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.839217] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.859215] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.859387] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.859528] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.859723] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.861156] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-224a8271-db53-4a15-822e-44205919dfec taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.861156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.861156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.861156] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.861156] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('224a8271-db53-4a15-822e-44205919dfec',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.019265] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.019461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.019461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.019651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.019742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.019948] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.020059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.020120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.020321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.020398] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.020482] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 already deleted. [ 1247.020560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.364469] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.364768] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.364823] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.365110] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.365299] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.365413] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 224a8271-db53-4a15-822e-44205919dfec not found, creating... [ 1247.365668] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.365966] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.365966] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.366190] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.366322] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.366606] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.366760] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.366872] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.367094] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.367225] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.367364] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 224a8271-db53-4a15-822e-44205919dfec is going to be created. [ 1247.388729] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.388951] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.389134] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.389425] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.389706] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.389998] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.091865] env[65319]: INFO networking_nsxv3.common.synchronization [req-a45eb84d-f96a-4b7a-b838-f5a27680284b req-01bac19a-7bf8-42f0-90ff-6d1c3790d993 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1248.091964] env[65319]: INFO networking_nsxv3.common.synchronization [req-a45eb84d-f96a-4b7a-b838-f5a27680284b req-01bac19a-7bf8-42f0-90ff-6d1c3790d993 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1248.092127] env[65319]: INFO networking_nsxv3.common.synchronization [req-a45eb84d-f96a-4b7a-b838-f5a27680284b req-01bac19a-7bf8-42f0-90ff-6d1c3790d993 service nova] Enqueued Resource ID: 224a8271-db53-4a15-822e-44205919dfec with Priority: HIGHEST for action port [ 1248.092666] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1248.092804] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1248.092919] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 224a8271-db53-4a15-822e-44205919dfec with Priority: HIGHEST for action port [ 1248.093196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.093762] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.093840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.094055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.094143] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.095104] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.095104] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.095296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.095354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.095522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.095616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.095616] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.095872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.096135] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.096135] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.096858] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-224a8271-db53-4a15-822e-44205919dfec taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.097227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.097227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.097227] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.097227] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('224a8271-db53-4a15-822e-44205919dfec',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.599037] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.599037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.599487] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.600199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 224a8271-db53-4a15-822e-44205919dfec with status ACTIVE [ 1248.600418] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.600547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.600611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.600828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.600907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.601132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.601346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.601427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.601611] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.601698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.601899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.602029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.602101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.602256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.602336] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.602606] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 224a8271-db53-4a15-822e-44205919dfec is going to be updated. [ 1248.630468] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.630663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.630707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.630892] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.631042] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.631210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-224a8271-db53-4a15-822e-44205919dfec" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.688161] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 in Status: SUCCESS [ 1248.688426] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 deletion is rescheduled due to dependency. [ 1248.688559] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.104520] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.607297] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.607702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.607702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.607776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.607830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.607927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be created. [ 1249.631588] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.631783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.631783] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.631930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.632101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.642130] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: UNINITIALIZED for 2s [ 1250.174616] env[65319]: INFO networking_nsxv3.common.synchronization [req-d7cb35c3-bf59-4c83-bed1-1ca0d58dc7d4 req-7ed44cf3-c209-4386-8498-cf38f8e2f577 tempest-ServerAddressesTestJSON-1031770480 tempest-ServerAddressesTestJSON-1031770480-project-member] Enqueued Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1250.175132] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGHEST for action security_group_members [ 1250.175460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.175592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.175692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.175939] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.176115] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.176209] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.176276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.176424] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.176507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.176601] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.680549] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.680943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.680943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.681066] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.681147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.681383] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.681484] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.681614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.681697] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.681774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.681861] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 is going to be updated. [ 1250.711015] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.711240] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.711312] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.711603] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.711692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.720917] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: IN_PROGRESS for 2s [ 1250.814372] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1250.814656] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1251.652358] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1251.652658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.652825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.653198] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.653405] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.653528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.653592] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.653778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.653836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.653918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.654016] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.156605] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.659085] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1252.676864] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.676864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.677052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.677126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.677217] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.677461] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.677562] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.677625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.677771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.677845] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.677927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be created. [ 1252.730336] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 in Status: SUCCESS [ 1252.730525] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 deletion is rescheduled due to dependency. [ 1252.730629] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.746926] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.747126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.747126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.747333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.747510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.758539] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1254.773130] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1254.773523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.176353] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.176467] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.142062] env[65319]: INFO networking_nsxv3.common.synchronization [None req-66db6837-6551-4cf1-a789-cc5385e31cdf None None] Enqueued Resource ID: cf05e634-dde4-45b1-801f-18a7b40ac35b with Priority: HIGHEST for action port [ 1258.142673] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf05e634-dde4-45b1-801f-18a7b40ac35b with Priority: HIGHEST for action port [ 1258.144487] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf05e634-dde4-45b1-801f-18a7b40ac35b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.144650] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf05e634-dde4-45b1-801f-18a7b40ac35b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.145434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf05e634-dde4-45b1-801f-18a7b40ac35b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.145713] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf05e634-dde4-45b1-801f-18a7b40ac35b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.145802] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf05e634-dde4-45b1-801f-18a7b40ac35b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.648725] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf05e634-dde4-45b1-801f-18a7b40ac35b [ 1258.649045] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.649232] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.649319] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.649536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.649632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.650422] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf05e634-dde4-45b1-801f-18a7b40ac35b already deleted. [ 1258.650422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf05e634-dde4-45b1-801f-18a7b40ac35b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.144107] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.144508] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1268.145526] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.145917] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.598346] env[65319]: INFO networking_nsxv3.common.synchronization [req-8621c6d5-2038-4c27-8c28-2899a7532326 req-18694737-be91-492e-808b-64014fdb240f tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1271.598922] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGHEST for action security_group_members [ 1271.599254] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.599380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.599447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.599644] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.599804] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.599901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.599964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.600263] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.600356] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.600453] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.103256] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.103487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.103487] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.103699] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.103790] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.103984] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.104094] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.104156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.104303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.104379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.104465] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 is going to be updated. [ 1272.134775] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.135026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.135026] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.135201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.135340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.144285] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: IN_PROGRESS for 2s [ 1274.155615] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2f924d-86a5-4614-914f-e20be4da25d9 in Status: SUCCESS [ 1274.156015] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 deletion is rescheduled due to dependency. [ 1274.156015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.461696] env[65319]: INFO networking_nsxv3.common.synchronization [req-cc82bee5-4f48-4e92-ad06-b4a10ef3ea02 req-19292493-deac-4fea-b075-f9baf8aa7682 tempest-AttachVolumeNegativeTest-1273077339 tempest-AttachVolumeNegativeTest-1273077339-project-member] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1275.462275] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGHEST for action security_group_members [ 1275.462692] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.462759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.462797] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.463095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.463730] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.463730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.463730] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.463904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.463943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.464368] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.967066] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.967277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.967277] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.967462] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.967558] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.967776] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.967903] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.967946] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.968084] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.968163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.968430] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 is going to be updated. [ 1275.996347] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.996556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.996556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.996731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.996872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.006094] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: IN_PROGRESS for 2s [ 1278.018163] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 in Status: SUCCESS [ 1278.018564] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 deletion is rescheduled due to dependency. [ 1278.018619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.463458] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.463458] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1282.167130] env[65319]: INFO networking_nsxv3.common.synchronization [req-79be2d25-54d0-48f7-839f-b1dfad250666 req-10fa1c26-57dc-4893-916c-be379804012a tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1282.168225] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1282.168340] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.168447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.168526] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.169876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.169876] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.169876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.169876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.169876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.169876] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.169876] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.672351] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.175071] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.677632] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.677807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.677851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.678103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.678202] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.678301] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be updated. [ 1283.709070] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.709268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.709309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.709510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.709658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.718471] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1285.730070] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1285.730503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.168691] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.169146] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.913902] env[65319]: INFO networking_nsxv3.common.synchronization [req-6cf1df44-a2e9-4c67-bb39-3792f15d61ac req-4acc3f2c-66f3-4521-b391-86dc237f301b tempest-ServerRescueNegativeTestJSON-1125130615 tempest-ServerRescueNegativeTestJSON-1125130615-project-member] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1288.914498] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGHEST for action security_group_members [ 1288.914856] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.914924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.914992] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.915216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.915365] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.915465] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.915528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.915675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.915761] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.915852] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.418053] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.418053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.418053] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.418399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.418498] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.418723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.418840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.418904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.419082] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.419161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.419247] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be updated. [ 1289.449955] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.450163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.450205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.450407] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.450549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.460611] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: IN_PROGRESS for 2s [ 1291.473107] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 in Status: SUCCESS [ 1291.473480] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 deletion is rescheduled due to dependency. [ 1291.473480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.915686] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.916048] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.916829] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.917230] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.768572] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.769047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.769047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.769047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.769172] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.271892] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.774093] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.277193] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1303.277428] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1303.918305] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.918686] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.072676] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.072966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.072966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.073124] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.086009] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1304.087121] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.088390] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1304.138511] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.138805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.138805] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.139014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.153035] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.153849] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1304.153933] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.154036] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1304.214883] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.215185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.215185] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.215308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.216665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.216863] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1304.306359] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.306586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.306586] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.306775] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.307101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.307399] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1304.387483] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.387787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.387787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.387963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.388340] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.388662] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1304.388779] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5bd590ec-aafc-4836-92d2-a1ad91f3849f', '57b692c1-c9a8-4318-94f5-2184ff1f58ef', '839965b7-f21e-4ee2-ae26-d772962e5f52', '9729f66f-3933-4e9d-9ee7-82962d006fe2', 'fe2f924d-86a5-4614-914f-e20be4da25d9', '07a8f66a-9056-4e9f-9d07-159ac5f0a6d7', '9017d4b0-791a-4ebd-9f2d-0db22fee76c4', '1c9a3208-9f97-4dae-ab4b-0e8e455efe41', '47634945-8e30-46dc-82da-93cd5685cbc3', 'b6b09724-e475-4a72-9a9a-5f9d496d4627', 'e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7', 'bdec9d4c-9475-4260-8af9-fba7e4820934', 'a0a6c793-0760-435d-be82-33d755948f79', '21b6477e-560e-44cf-bf38-d612f918ff7e', '1d4f77cd-1627-4596-b51b-813b08ea21e4', '7a8cfb58-c5d8-4371-a4d8-cce23cb883e5', '5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8', '848d35f9-8739-4545-aabc-ff592d03c0e0', '08b741bf-ee28-4b27-bf6a-78bf52eb3be6', 'a329f993-c39f-4fa0-aa69-6368abd88e7b', '53a1e5a3-4b59-400c-b2d3-35a9514b015c', '0f47eb94-bdf5-494d-a378-78951389d1ea', 'dadc0194-ac9d-406b-a9c6-ec6492e3d268', '746f1312-5d40-4fc8-b702-cb8a17f5faa8', '647501a8-60c2-4fb9-8e6d-3340ae1b9ac1', '6058afe7-0c04-438a-8ff7-fa0b65021981', 'd51d74c1-0bc9-4f08-9e69-0f36720ce33b', '73bd0d96-c37a-417f-a9ec-9f3f59a6889c', '168faf57-13be-4d1b-8a5c-4618e12dde52', '7803898b-69e4-4d33-860f-8dbb01043ade', '658fe8b2-be4c-42fb-841e-f105abeb65cc', '5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0', '282f1cfb-aa79-42a6-936b-877f8ae71035', 'e04b5099-c245-45bb-ba03-28eba19d17c1', 'dace3c2b-1f26-48fa-aa8e-522105a27e45', '23e179a6-db4e-4e51-ab65-7ae45a30f94e', 'f0e2a77d-4c21-497a-85f5-76d08cf9878e', '2fb71eb3-0fda-4e33-ae51-390153750f63', '64c67b2e-cc70-45f4-b07c-aa5250deaa33', 'b95d83bf-87be-46fb-a121-6221d6adfa83', '2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa', 'a1c365c2-b0da-43cf-8088-9c38fa4c5ec9', 'fd0a2e0b-8eec-4c51-b1ed-6efc9f219567', '1e81f5f5-3357-4ba5-96ae-679bd5c9617f'} {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.388873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1304.411201] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.411435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.411435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.411706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.411759] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.411875] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1304.412158] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.412290] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1304.494828] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.495102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.495102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.495370] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.496441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.496718] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1304.496794] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.496867] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1304.496932] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1304.497015] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1304.497100] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGH for action security_group_rules [ 1304.497180] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGH for action security_group_rules [ 1304.497247] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGH for action security_group_rules [ 1304.497312] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGH for action security_group_rules [ 1304.497370] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGH for action security_group_rules [ 1304.497425] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGH for action security_group_rules [ 1304.497490] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGH for action security_group_rules [ 1304.497600] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGH for action security_group_rules [ 1304.497600] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGH for action security_group_rules [ 1304.497683] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGH for action security_group_rules [ 1304.497717] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGH for action security_group_rules [ 1304.497774] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGH for action security_group_rules [ 1304.497839] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGH for action security_group_rules [ 1304.497888] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGH for action security_group_rules [ 1304.497936] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGH for action security_group_rules [ 1304.497996] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGH for action security_group_rules [ 1304.498074] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGH for action security_group_rules [ 1304.498129] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGH for action security_group_rules [ 1304.498175] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGH for action security_group_rules [ 1304.498238] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGH for action security_group_rules [ 1304.498337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a329f993-c39f-4fa0-aa69-6368abd88e7b with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 with Priority: HIGH for action security_group_rules [ 1308.920654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 with Priority: HIGH for action security_group_rules [ 1308.921285] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGH for action security_group_rules [ 1308.921378] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b6477e-560e-44cf-bf38-d612f918ff7e with Priority: HIGH for action security_group_rules [ 1308.921487] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 with Priority: HIGH for action security_group_rules [ 1308.921588] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6c793-0760-435d-be82-33d755948f79 with Priority: HIGH for action security_group_rules [ 1308.921809] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdec9d4c-9475-4260-8af9-fba7e4820934 with Priority: HIGH for action security_group_rules [ 1308.921809] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 with Priority: HIGH for action security_group_rules [ 1308.921943] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 with Priority: HIGH for action security_group_rules [ 1308.921943] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47634945-8e30-46dc-82da-93cd5685cbc3 with Priority: HIGH for action security_group_rules [ 1308.922068] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 with Priority: HIGH for action security_group_rules [ 1308.922183] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 with Priority: HIGH for action security_group_rules [ 1308.922358] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2f924d-86a5-4614-914f-e20be4da25d9 with Priority: HIGH for action security_group_rules [ 1308.922358] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef with Priority: HIGH for action security_group_rules [ 1308.922479] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 with Priority: HIGH for action security_group_rules [ 1308.922767] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.922900] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.922959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.923181] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.923283] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd590ec-aafc-4836-92d2-a1ad91f3849f',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.924294] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839965b7-f21e-4ee2-ae26-d772962e5f52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.924409] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.924470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.924636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.924705] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839965b7-f21e-4ee2-ae26-d772962e5f52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.925661] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.925765] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.925834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.925981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.926062] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9017d4b0-791a-4ebd-9f2d-0db22fee76c4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.926756] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d4f77cd-1627-4596-b51b-813b08ea21e4 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.926875] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.926930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.927581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.927581] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d4f77cd-1627-4596-b51b-813b08ea21e4',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.927965] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a329f993-c39f-4fa0-aa69-6368abd88e7b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.927965] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.928230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.928230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.928230] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a329f993-c39f-4fa0-aa69-6368abd88e7b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.929086] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.929086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.929086] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.929267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.929267] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b741bf-ee28-4b27-bf6a-78bf52eb3be6',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.930055] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-848d35f9-8739-4545-aabc-ff592d03c0e0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.930179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.930265] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.930368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.930432] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('848d35f9-8739-4545-aabc-ff592d03c0e0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.931143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.931243] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.931308] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.931454] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.931521] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.932208] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b6477e-560e-44cf-bf38-d612f918ff7e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.932341] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.932382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.932750] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.932750] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b6477e-560e-44cf-bf38-d612f918ff7e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.933397] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.933397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.933397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.933567] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.933849] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a8cfb58-c5d8-4371-a4d8-cce23cb883e5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.934362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6c793-0760-435d-be82-33d755948f79 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.934478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.934525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.934665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.934725] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6c793-0760-435d-be82-33d755948f79',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.935609] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdec9d4c-9475-4260-8af9-fba7e4820934 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.935609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.935609] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.935755] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.935835] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdec9d4c-9475-4260-8af9-fba7e4820934',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.936763] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.936763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.936763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.936950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.936950] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.937818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6b09724-e475-4a72-9a9a-5f9d496d4627 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.937818] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.938192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.938192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.938280] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6b09724-e475-4a72-9a9a-5f9d496d4627',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.938916] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47634945-8e30-46dc-82da-93cd5685cbc3 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.939068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.939138] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.939237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.939393] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47634945-8e30-46dc-82da-93cd5685cbc3',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.940085] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.940191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.940231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.940363] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.940435] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07a8f66a-9056-4e9f-9d07-159ac5f0a6d7',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.941361] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.941361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.941361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.941615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.941615] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9a3208-9f97-4dae-ab4b-0e8e455efe41',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.942323] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2f924d-86a5-4614-914f-e20be4da25d9 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.942390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.942425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.942566] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.942637] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2f924d-86a5-4614-914f-e20be4da25d9',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.943313] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.943405] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.943489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.943597] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.943663] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b692c1-c9a8-4318-94f5-2184ff1f58ef',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.944385] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9729f66f-3933-4e9d-9ee7-82962d006fe2 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.944491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.944491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.944624] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.944716] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9729f66f-3933-4e9d-9ee7-82962d006fe2',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.455065] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.455250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.455250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.455478] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.455657] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.455763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.455827] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.455983] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.456080] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.456168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.456255] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.526516] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.526760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.526869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.527170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.538875] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.539061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.540227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.540388] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.541423] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.541574] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.542512] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.542665] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.543657] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.543787] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.545132] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.545267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.546228] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.546383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.547355] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.547491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.548468] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.548627] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.549613] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.549751] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.550569] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.551162] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.551294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.552140] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.552620] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.552752] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.553587] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.554091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.554230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.555011] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.555525] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.555654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.556368] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.556833] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.556981] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.557808] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.558316] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.558455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.559248] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.559716] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.559840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.560614] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.561227] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.561384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.562832] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.563235] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.563351] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 848d35f9-8739-4545-aabc-ff592d03c0e0 is going to be deleted. [ 1309.564210] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.564427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.581346] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.581471] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a329f993-c39f-4fa0-aa69-6368abd88e7b is going to be deleted. [ 1309.582547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.582821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.604122] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.604331] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd590ec-aafc-4836-92d2-a1ad91f3849f is going to be deleted. [ 1309.605161] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.605379] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.618768] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.618932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.623245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.623363] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6c793-0760-435d-be82-33d755948f79 is going to be deleted. [ 1309.624245] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.624461] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.639208] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.639372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.648109] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.648240] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9017d4b0-791a-4ebd-9f2d-0db22fee76c4 is going to be deleted. [ 1309.649139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.649349] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.667027] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.667212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.674073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.674251] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839965b7-f21e-4ee2-ae26-d772962e5f52 is going to be deleted. [ 1309.675197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.675422] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.708867] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.709090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.756319] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.756524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.781673] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.781854] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6b09724-e475-4a72-9a9a-5f9d496d4627 is going to be deleted. [ 1309.782748] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.782964] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.794648] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.794843] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.832307] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.832478] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7 is going to be deleted. [ 1309.833368] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.833583] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.862640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.862855] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47634945-8e30-46dc-82da-93cd5685cbc3 is going to be deleted. [ 1309.863718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.863941] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.881899] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.882116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.893588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.893748] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d4f77cd-1627-4596-b51b-813b08ea21e4 is going to be deleted. [ 1309.894641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.894870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.926106] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.926481] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b741bf-ee28-4b27-bf6a-78bf52eb3be6 is going to be deleted. [ 1309.927143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.927362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.928747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.928850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.952440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.952618] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9a3208-9f97-4dae-ab4b-0e8e455efe41 is going to be deleted. [ 1309.953525] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.953756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.955136] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.955250] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.975550] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.983453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.983594] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b692c1-c9a8-4318-94f5-2184ff1f58ef is going to be deleted. [ 1309.984534] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.984758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.997185] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.997390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.002868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.003045] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.008727] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.008852] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdec9d4c-9475-4260-8af9-fba7e4820934 is going to be deleted. [ 1310.009772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.009976] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.030200] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.030453] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.031831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.031949] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a8cfb58-c5d8-4371-a4d8-cce23cb883e5 is going to be deleted. [ 1310.032871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.033102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.054674] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.054858] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b6477e-560e-44cf-bf38-d612f918ff7e is going to be deleted. [ 1310.056529] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.056738] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.072475] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.072654] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.087912] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.088070] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2f924d-86a5-4614-914f-e20be4da25d9 is going to be deleted. [ 1310.088966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.089201] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.116786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.117103] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07a8f66a-9056-4e9f-9d07-159ac5f0a6d7 is going to be deleted. [ 1310.118029] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.118237] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.119749] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.119925] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.144339] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.144536] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.145174] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.145272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.149268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.149441] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9729f66f-3933-4e9d-9ee7-82962d006fe2 is going to be deleted. [ 1310.150572] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.150814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.150970] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.151131] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-848d35f9-8739-4545-aabc-ff592d03c0e0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.151321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.151469] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.151554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.151671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a329f993-c39f-4fa0-aa69-6368abd88e7b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.152228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.152417] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.152505] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.152625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd590ec-aafc-4836-92d2-a1ad91f3849f" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.152758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.152906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.152982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.153113] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6c793-0760-435d-be82-33d755948f79" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.153241] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.153385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.153460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.153578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9017d4b0-791a-4ebd-9f2d-0db22fee76c4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.153707] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.153846] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.153922] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.154052] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839965b7-f21e-4ee2-ae26-d772962e5f52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.154184] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.154329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.154403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.154515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6b09724-e475-4a72-9a9a-5f9d496d4627" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.154728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.154873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.154968] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155102] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e98c538b-cb56-44c0-a6b7-2ee0fb9e61c7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155230] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.155329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.155402] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155515] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47634945-8e30-46dc-82da-93cd5685cbc3" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.155773] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.155847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.155959] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b741bf-ee28-4b27-bf6a-78bf52eb3be6" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.156103] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.156244] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.156316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.156431] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d4f77cd-1627-4596-b51b-813b08ea21e4" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.156554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.156690] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.156764] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.156880] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9a3208-9f97-4dae-ab4b-0e8e455efe41" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.157009] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.157168] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.157246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.157359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b692c1-c9a8-4318-94f5-2184ff1f58ef" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.157485] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.157621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.157694] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.157806] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdec9d4c-9475-4260-8af9-fba7e4820934" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.157930] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.158089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.158166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.158275] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b6477e-560e-44cf-bf38-d612f918ff7e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.158399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.158537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.158608] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.158710] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a8cfb58-c5d8-4371-a4d8-cce23cb883e5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.168845] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.169021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.169074] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.169258] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.169342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.169460] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2f924d-86a5-4614-914f-e20be4da25d9" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.193632] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.193791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.193850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.194047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.194137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.194268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07a8f66a-9056-4e9f-9d07-159ac5f0a6d7" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.216310] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.216455] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.216527] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.216731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.216821] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.216943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9729f66f-3933-4e9d-9ee7-82962d006fe2" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.478198] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1310.496523] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.496701] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.496746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.496937] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.516337] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.516664] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.516792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.516860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.517075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.517162] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.517271] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1310.576659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.576841] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.576886] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.577087] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.577236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.591964] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1312.606132] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1312.606506] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.924022] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.924476] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.925192] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.925602] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.926395] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.927278] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.928272] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.928778] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.929052] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.929374] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.930495] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.930871] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.932210] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.932626] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.933562] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.933985] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.934377] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.934714] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.936040] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.936040] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.936712] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.937030] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.937992] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.938386] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.939112] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.939526] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.537763] env[65319]: INFO networking_nsxv3.common.synchronization [req-cb1a84d5-9c72-4b77-a10c-de31fd08022a req-95d4c605-8cb3-4d67-98f5-aceae2c2cfe0 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1376.538095] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1376.538671] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.538671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.538671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.538872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.539040] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.539136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.539410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.539410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.539510] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.539586] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.042551] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.042831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.042831] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.043050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.043050] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.043255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.043360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.043432] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.043585] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.043663] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.043748] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1377.078383] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.078598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.078598] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.078763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.078909] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.088900] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1379.099613] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1379.100015] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 deletion is rescheduled due to dependency. [ 1379.100015] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.539715] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.540199] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.474906] env[65319]: INFO networking_nsxv3.common.synchronization [req-730bf315-a5b2-4679-b64c-5b37e0ac0a86 req-2f9e0492-3bc4-46df-8e36-83eceecb6303 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1383.475497] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1383.475872] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.476037] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.476130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.476374] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.476550] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.476685] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.476760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.476955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.477068] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.477198] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.742239] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.742439] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.742568] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.742830] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.743126] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.743326] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.743447] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.743666] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.743826] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.744074] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1383.744189] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1383.744300] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1383.744403] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1383.744510] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1383.744613] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1383.744756] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1383.765600] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1383.765764] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1383.765912] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1383.766093] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.766388] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-72db0340-f596-4070-91de-16749dfc6cd1 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.766552] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.766671] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.766988] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.767160] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72db0340-f596-4070-91de-16749dfc6cd1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.979997] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.980303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.980303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.980535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.980535] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.980739] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.980836] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.980897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.981063] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.981141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.981226] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1384.009802] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.010031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.010031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.010216] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.010353] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.018923] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1384.269115] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.269278] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.269456] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.269669] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.269816] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.269970] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 72db0340-f596-4070-91de-16749dfc6cd1 not found, creating... [ 1384.270252] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.270422] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.270559] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.270779] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.270912] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.271215] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.271372] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.271486] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.271780] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.271837] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.271937] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 72db0340-f596-4070-91de-16749dfc6cd1 is going to be created. [ 1384.291831] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.292070] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.292193] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.292450] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.292674] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.292885] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.991087] env[65319]: INFO networking_nsxv3.common.synchronization [req-730bf315-a5b2-4679-b64c-5b37e0ac0a86 req-90e13f27-65c0-4e02-8b96-2605ecf6fbe3 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1384.991087] env[65319]: INFO networking_nsxv3.common.synchronization [req-730bf315-a5b2-4679-b64c-5b37e0ac0a86 req-90e13f27-65c0-4e02-8b96-2605ecf6fbe3 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1384.991368] env[65319]: INFO networking_nsxv3.common.synchronization [req-730bf315-a5b2-4679-b64c-5b37e0ac0a86 req-90e13f27-65c0-4e02-8b96-2605ecf6fbe3 service nova] Enqueued Resource ID: 72db0340-f596-4070-91de-16749dfc6cd1 with Priority: HIGHEST for action port [ 1384.991786] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1384.991982] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1384.992511] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db0340-f596-4070-91de-16749dfc6cd1 with Priority: HIGHEST for action port [ 1384.992825] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.992950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.993030] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.993242] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.993325] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.994307] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.994399] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.994831] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-72db0340-f596-4070-91de-16749dfc6cd1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.994913] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.995022] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.995143] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.995223] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72db0340-f596-4070-91de-16749dfc6cd1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.497293] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.497490] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.497535] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72db0340-f596-4070-91de-16749dfc6cd1 with status ACTIVE [ 1385.497727] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.497849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.497904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.498139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.498255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.498434] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.498503] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.498547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.498706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.498770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.498950] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.499057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.499116] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.499256] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.499329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.499412] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72db0340-f596-4070-91de-16749dfc6cd1 is going to be updated. [ 1385.519441] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.519638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.519638] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.519873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.520017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.520171] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72db0340-f596-4070-91de-16749dfc6cd1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.029195] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1386.029615] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 deletion is rescheduled due to dependency. [ 1386.029615] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.029816] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.030076] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.030255] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.030372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.030433] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.030590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.030662] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.030761] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.533337] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.035983] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.538305] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.538475] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.538549] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.538774] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.538864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.538963] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1387.569011] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.569197] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.569238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.569442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.569588] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.581742] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1389.594396] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1389.594825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.594825] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.594987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.595195] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.595331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.595397] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.595541] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.595619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.595703] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.595795] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.993389] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.993556] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1390.098173] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.600462] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1390.618273] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.618489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.618489] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.618692] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.618807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.619051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.619190] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.619305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.619361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.619434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.619540] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1390.678890] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.679140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.679140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.679320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.679467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.693563] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1392.710155] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1392.710554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.994536] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.994536] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.995947] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.996361] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.996994] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.997379] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.998057] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.998463] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.998873] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.999269] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.999971] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.000393] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.001607] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.002064] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.002912] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.003322] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.004027] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.004533] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.005574] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.005574] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.006028] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.006389] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.007223] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.007773] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.008871] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.009338] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.009704] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.010082] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.011417] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.011759] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.012319] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.012741] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.013828] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.014168] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.015620] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.015620] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.752132] env[65319]: INFO networking_nsxv3.common.synchronization [req-7da453ee-bfa7-45df-b607-3eeafbd6dea6 req-f757580d-970c-4df0-a814-6d21a5f7cf41 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1482.753481] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1482.753481] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.753481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.753481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.753481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.753890] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.753890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.753890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.753890] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.754051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.754051] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.256631] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.256862] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.256994] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.257139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.257233] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.257499] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.257581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.257618] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.257766] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.257840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.257953] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1483.292851] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.293079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.293079] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.293317] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.293463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.302749] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1485.314341] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1485.314721] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 deletion is rescheduled due to dependency. [ 1485.314721] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.754093] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.754563] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.814014] env[65319]: INFO networking_nsxv3.common.synchronization [req-368c3226-9683-4cc8-8953-05583e2a538c req-5d20ef9a-652a-42ca-a523-647406b209e9 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1490.814604] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1490.814884] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1490.814948] env[65319]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72ab94a2-2786-4861-9cb7-dac5d747eee6 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1490.815366] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.815493] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.815554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.815753] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.815907] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.816012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.816075] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.816224] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.816329] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.816455] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.115965] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.116179] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.116312] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.116594] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.117190] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.117360] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.117565] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.117805] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.117963] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.118182] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1491.118293] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1491.118400] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1491.118508] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1491.118615] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1491.118717] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1491.118844] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1491.138888] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1491.139051] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1491.139179] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1491.139350] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.139667] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.139864] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.139983] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.140298] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.140511] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6de0cb-b59e-4eea-a6dd-09c92312f6a5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1491.318622] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.318848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.318848] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.319021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.319139] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.319337] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.319441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.319504] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.319702] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.319815] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.319913] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1491.344248] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.344473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.344473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.344622] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.344760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.352729] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1491.643255] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.643484] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.643613] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.643903] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.644069] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.644230] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Segment Port 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 not found, creating... [ 1491.644552] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.644720] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.644876] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.645078] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.645217] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.645504] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.645659] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.645775] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.645981] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.646128] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.646266] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 is going to be created. [ 1491.665598] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1491.665821] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1491.665903] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1491.666181] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1491.666407] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1491.666622] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.346220] env[65319]: INFO networking_nsxv3.common.synchronization [req-368c3226-9683-4cc8-8953-05583e2a538c req-0dcc73ee-bd59-49b6-86b5-0713ea02efe3 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1492.346559] env[65319]: INFO networking_nsxv3.common.synchronization [req-368c3226-9683-4cc8-8953-05583e2a538c req-0dcc73ee-bd59-49b6-86b5-0713ea02efe3 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1492.346559] env[65319]: INFO networking_nsxv3.common.synchronization [req-368c3226-9683-4cc8-8953-05583e2a538c req-0dcc73ee-bd59-49b6-86b5-0713ea02efe3 service nova] Enqueued Resource ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with Priority: HIGHEST for action port [ 1492.347016] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1492.347162] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1492.347260] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with Priority: HIGHEST for action port [ 1492.347561] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.347641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.347706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.347898] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.347981] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.348793] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.348916] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.349093] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.349208] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.349257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.349404] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.349479] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6de0cb-b59e-4eea-a6dd-09c92312f6a5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1492.852062] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.852279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.852331] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with status ACTIVE [ 1492.852615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.852763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.852849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.853097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.853221] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.853468] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.853590] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.853672] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.853858] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.853962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.854196] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.854316] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.854415] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.854531] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.854640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.854715] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 is going to be updated. [ 1492.875674] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1492.875905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1492.875905] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1492.876137] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1492.876276] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.876441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.361974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1493.362361] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 deletion is rescheduled due to dependency. [ 1493.362361] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.362435] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.362633] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.362820] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.362936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.362997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.363170] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.363279] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.363394] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.865805] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.367700] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.870432] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.870661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.870661] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.870889] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.870985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.871096] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1494.898456] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.898606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.898675] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.898878] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.899033] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.907663] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1496.918679] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1496.919057] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.919100] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.919300] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.919497] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.919621] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.919686] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.919842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.919923] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.920016] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.920113] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.348581] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.348751] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1497.422272] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.925115] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1497.946902] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.947167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.947167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.947343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.947441] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.947702] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.947810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.947877] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.948055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.948136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.948227] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1498.005762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.005962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.005962] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.006163] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.006315] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.024357] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1500.039936] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1500.040331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.349262] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.349653] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.349718] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.350063] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.350982] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.351419] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.352155] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.352523] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.354113] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.354522] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.356125] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.356500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.357506] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.357927] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.358836] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.359220] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.770488] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.770488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.770488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.770488] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.770488] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.272601] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.360471] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.360654] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.774897] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.276822] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1543.276974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1544.021427] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.021837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.021837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.021837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.034759] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1544.035607] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.036437] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1544.075181] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.075385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.075385] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.075606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.089463] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.090374] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1544.090455] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.090546] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1544.124453] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.124679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.124679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.124870] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.125494] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.125638] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1544.201933] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.202151] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.202200] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.202383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.202700] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.202979] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1544.282903] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.283069] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.283166] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.283382] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.283712] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.284052] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:25. [ 1544.284144] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8', '0f47eb94-bdf5-494d-a378-78951389d1ea', '53a1e5a3-4b59-400c-b2d3-35a9514b015c', '6058afe7-0c04-438a-8ff7-fa0b65021981', 'dadc0194-ac9d-406b-a9c6-ec6492e3d268', '746f1312-5d40-4fc8-b702-cb8a17f5faa8', '647501a8-60c2-4fb9-8e6d-3340ae1b9ac1', 'd51d74c1-0bc9-4f08-9e69-0f36720ce33b', '73bd0d96-c37a-417f-a9ec-9f3f59a6889c', '168faf57-13be-4d1b-8a5c-4618e12dde52', '7803898b-69e4-4d33-860f-8dbb01043ade', '658fe8b2-be4c-42fb-841e-f105abeb65cc', '5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0', '282f1cfb-aa79-42a6-936b-877f8ae71035', 'e04b5099-c245-45bb-ba03-28eba19d17c1', 'dace3c2b-1f26-48fa-aa8e-522105a27e45', '23e179a6-db4e-4e51-ab65-7ae45a30f94e', 'f0e2a77d-4c21-497a-85f5-76d08cf9878e', '2fb71eb3-0fda-4e33-ae51-390153750f63', '64c67b2e-cc70-45f4-b07c-aa5250deaa33', 'b95d83bf-87be-46fb-a121-6221d6adfa83', '2fa8a1f8-5f9b-4def-8b6f-51a33a79beaa', 'a1c365c2-b0da-43cf-8088-9c38fa4c5ec9', 'fd0a2e0b-8eec-4c51-b1ed-6efc9f219567', '1e81f5f5-3357-4ba5-96ae-679bd5c9617f'} {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.284231] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1544.305426] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.305641] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.305696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.305881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.306019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.306095] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1544.306178] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.306248] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1544.383762] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.383950] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.384073] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.384296] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.385439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.385714] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1544.385797] env[65319]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65319) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.385873] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1544.385945] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1544.386035] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/25 resources of Type:Security Group Rules [ 1544.386114] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGH for action security_group_rules [ 1544.386217] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGH for action security_group_rules [ 1544.386299] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGH for action security_group_rules [ 1544.386368] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGH for action security_group_rules [ 1544.386435] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGH for action security_group_rules [ 1544.386500] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGH for action security_group_rules [ 1544.386565] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGH for action security_group_rules [ 1544.386631] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGH for action security_group_rules [ 1544.386695] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGH for action security_group_rules [ 1544.386761] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGH for action security_group_rules [ 1544.386825] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGH for action security_group_rules [ 1544.386890] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGH for action security_group_rules [ 1544.386955] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGH for action security_group_rules [ 1544.387029] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGH for action security_group_rules [ 1544.387096] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGH for action security_group_rules [ 1544.387161] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGH for action security_group_rules [ 1544.387226] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGH for action security_group_rules [ 1544.387291] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGH for action security_group_rules [ 1544.387356] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGH for action security_group_rules [ 1544.387421] env[65319]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGH for action security_group_rules [ 1544.387519] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.362031] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.362434] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1547.362434] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGH for action security_group_rules [ 1547.362561] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c with Priority: HIGH for action security_group_rules [ 1547.362561] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 with Priority: HIGH for action security_group_rules [ 1547.362835] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04b5099-c245-45bb-ba03-28eba19d17c1 with Priority: HIGH for action security_group_rules [ 1547.362835] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 with Priority: HIGH for action security_group_rules [ 1547.362835] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 with Priority: HIGH for action security_group_rules [ 1547.363135] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e with Priority: HIGH for action security_group_rules [ 1547.363135] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e with Priority: HIGH for action security_group_rules [ 1547.363135] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 with Priority: HIGH for action security_group_rules [ 1547.363313] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 with Priority: HIGH for action security_group_rules [ 1547.363313] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 with Priority: HIGH for action security_group_rules [ 1547.363421] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc with Priority: HIGH for action security_group_rules [ 1547.363477] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7803898b-69e4-4d33-860f-8dbb01043ade with Priority: HIGH for action security_group_rules [ 1547.363536] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 with Priority: HIGH for action security_group_rules [ 1547.363589] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c with Priority: HIGH for action security_group_rules [ 1547.363710] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 with Priority: HIGH for action security_group_rules [ 1547.363809] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b with Priority: HIGH for action security_group_rules [ 1547.363924] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 with Priority: HIGH for action security_group_rules [ 1547.364021] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f47eb94-bdf5-494d-a378-78951389d1ea with Priority: HIGH for action security_group_rules [ 1547.364108] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 with Priority: HIGH for action security_group_rules [ 1547.364460] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.364596] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.364655] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.364872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.364976] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.366050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.366228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.366228] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.366416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.366488] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a1e5a3-4b59-400c-b2d3-35a9514b015c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.367595] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.367718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.367718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.367851] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.367903] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647501a8-60c2-4fb9-8e6d-3340ae1b9ac1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.369120] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04b5099-c245-45bb-ba03-28eba19d17c1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.369120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.369120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.369120] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.369120] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04b5099-c245-45bb-ba03-28eba19d17c1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.369746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.369847] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.369904] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.370507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.370507] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64c67b2e-cc70-45f4-b07c-aa5250deaa33',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.370832] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fb71eb3-0fda-4e33-ae51-390153750f63 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.370940] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.371024] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.371188] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.371687] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fb71eb3-0fda-4e33-ae51-390153750f63',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.372102] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.372203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.372267] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.372444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.372502] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0e2a77d-4c21-497a-85f5-76d08cf9878e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.373184] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.373284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.373386] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.373491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.373557] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23e179a6-db4e-4e51-ab65-7ae45a30f94e',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.374279] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-282f1cfb-aa79-42a6-936b-877f8ae71035 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.375047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.375047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.375047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.375047] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('282f1cfb-aa79-42a6-936b-877f8ae71035',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.375332] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dace3c2b-1f26-48fa-aa8e-522105a27e45 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.375434] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.375492] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.375643] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.375717] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dace3c2b-1f26-48fa-aa8e-522105a27e45',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.376526] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.376639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.376706] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.376850] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.376925] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.377779] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-658fe8b2-be4c-42fb-841e-f105abeb65cc taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.377779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.377779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.377934] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.378013] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('658fe8b2-be4c-42fb-841e-f105abeb65cc',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.378818] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7803898b-69e4-4d33-860f-8dbb01043ade taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.379261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.379261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.379261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.379261] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7803898b-69e4-4d33-860f-8dbb01043ade',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.380012] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-168faf57-13be-4d1b-8a5c-4618e12dde52 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.380145] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.380271] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.380604] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.380604] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('168faf57-13be-4d1b-8a5c-4618e12dde52',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.381125] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.381236] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.381333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.381447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.381522] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73bd0d96-c37a-417f-a9ec-9f3f59a6889c',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.382217] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.382325] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.382392] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.382543] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.382616] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('746f1312-5d40-4fc8-b702-cb8a17f5faa8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.383313] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.383425] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.383491] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.383640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.383712] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d51d74c1-0bc9-4f08-9e69-0f36720ce33b',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.384587] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.384696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.384778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.384963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.385085] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dadc0194-ac9d-406b-a9c6-ec6492e3d268',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.385705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f47eb94-bdf5-494d-a378-78951389d1ea taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.385808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.385860] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.386019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.386100] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f47eb94-bdf5-494d-a378-78951389d1ea',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.386897] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6058afe7-0c04-438a-8ff7-fa0b65021981 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.387031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.387101] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.387251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.387324] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6058afe7-0c04-438a-8ff7-fa0b65021981',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.391685] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.391830] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.391906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.392017] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.392175] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.392303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.392343] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.392829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.392829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.392829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.392829] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.413367] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.413514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.413584] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.413791] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.436829] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.437029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a1e5a3-4b59-400c-b2d3-35a9514b015c is going to be deleted. [ 1547.497830] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.498095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.498095] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.498278] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.498394] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.498528] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a1e5a3-4b59-400c-b2d3-35a9514b015c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.919507] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.940416] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1547.973348] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.973556] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.973659] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.973995] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.988522] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.988757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.990063] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.990211] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.993615] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.993785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.001545] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.001772] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.002976] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.003136] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.004163] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.004298] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.005267] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.005396] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.006389] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.006523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.007623] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.008055] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.008857] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.008955] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.009590] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.010189] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.010320] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.011156] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.011724] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.011872] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.013067] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.013579] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.013718] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.014587] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.015159] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.015342] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.016053] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.016467] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.016577] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.017193] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.017582] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.017689] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.018626] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.019098] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.019212] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.019778] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.020179] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.020309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0e2a77d-4c21-497a-85f5-76d08cf9878e is going to be deleted. [ 1548.021205] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.021416] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.022869] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.022969] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.040483] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.040644] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647501a8-60c2-4fb9-8e6d-3340ae1b9ac1 is going to be deleted. [ 1548.041678] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.041936] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.060447] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.060618] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73bd0d96-c37a-417f-a9ec-9f3f59a6889c is going to be deleted. [ 1548.061523] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.061792] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.093670] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.093872] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dace3c2b-1f26-48fa-aa8e-522105a27e45 is going to be deleted. [ 1548.094737] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.094977] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.096368] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.096480] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.097649] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.097744] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.121586] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.121804] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.129019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.129197] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 282f1cfb-aa79-42a6-936b-877f8ae71035 is going to be deleted. [ 1548.130129] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.130367] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.157849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.158029] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d51d74c1-0bc9-4f08-9e69-0f36720ce33b is going to be deleted. [ 1548.158884] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.159142] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.224659] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.224915] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.244679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.244963] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6058afe7-0c04-438a-8ff7-fa0b65021981 is going to be deleted. [ 1548.246059] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.246333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.248046] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.248165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.287333] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.287518] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64c67b2e-cc70-45f4-b07c-aa5250deaa33 is going to be deleted. [ 1548.288555] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.288800] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.332560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.332773] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23e179a6-db4e-4e51-ab65-7ae45a30f94e is going to be deleted. [ 1548.333625] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.333869] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.355022] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.355255] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.391464] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.391901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.408516] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.408680] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0 is going to be deleted. [ 1548.409589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.409834] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.454091] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.454291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.460438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.460619] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.496785] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.496958] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f47eb94-bdf5-494d-a378-78951389d1ea is going to be deleted. [ 1548.497982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.498290] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.501572] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.501778] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.552130] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.552309] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04b5099-c245-45bb-ba03-28eba19d17c1 is going to be deleted. [ 1548.553285] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.553537] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.711023] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.711234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.745581] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.745719] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 658fe8b2-be4c-42fb-841e-f105abeb65cc is going to be deleted. [ 1548.746732] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.746973] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.773786] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.773976] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dadc0194-ac9d-406b-a9c6-ec6492e3d268 is going to be deleted. [ 1548.775322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.775322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.802379] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.802551] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.816776] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.816776] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 746f1312-5d40-4fc8-b702-cb8a17f5faa8 is going to be deleted. [ 1548.818031] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.818354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.843961] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.844165] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.853660] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.853811] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7803898b-69e4-4d33-860f-8dbb01043ade is going to be deleted. [ 1548.854769] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.855011] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.007700] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.007891] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.018286] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.018601] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.018711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.018770] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.018988] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.019085] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.019186] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1549.020248] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.020423] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.058676] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.058881] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.077568] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.077828] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.078985] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.079132] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fb71eb3-0fda-4e33-ae51-390153750f63 is going to be deleted. [ 1549.080070] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.080322] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.080418] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.080547] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0e2a77d-4c21-497a-85f5-76d08cf9878e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.080705] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.080864] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.080944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.081072] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647501a8-60c2-4fb9-8e6d-3340ae1b9ac1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.081595] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.081756] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.081840] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.081980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73bd0d96-c37a-417f-a9ec-9f3f59a6889c" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.082156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.082305] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.082384] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.082507] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-282f1cfb-aa79-42a6-936b-877f8ae71035" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.082664] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.082810] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.082933] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.083062] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dace3c2b-1f26-48fa-aa8e-522105a27e45" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.083191] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.083331] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.083403] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.083511] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d51d74c1-0bc9-4f08-9e69-0f36720ce33b" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.083636] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.083814] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.083932] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.083980] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6058afe7-0c04-438a-8ff7-fa0b65021981" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.084156] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.084303] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.084380] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.084517] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23e179a6-db4e-4e51-ab65-7ae45a30f94e" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.084651] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.084789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.084863] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.084975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64c67b2e-cc70-45f4-b07c-aa5250deaa33" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.085119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.085257] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.085330] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.085449] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9292e7-f92c-43fe-8aae-e9ff8e7f06f0" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.085631] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.085779] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.085856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.086012] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f47eb94-bdf5-494d-a378-78951389d1ea" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.086147] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.086314] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.086390] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.086502] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04b5099-c245-45bb-ba03-28eba19d17c1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.086626] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.086760] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.086832] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.086944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-658fe8b2-be4c-42fb-841e-f105abeb65cc" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.087119] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.087261] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.087339] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.087477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dadc0194-ac9d-406b-a9c6-ec6492e3d268" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.087606] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.087743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.131302] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.131560] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.144856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.145090] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 168faf57-13be-4d1b-8a5c-4618e12dde52 is going to be deleted. [ 1549.145961] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.146192] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.146284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.146393] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-746f1312-5d40-4fc8-b702-cb8a17f5faa8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.146554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.146711] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.146789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.146895] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7803898b-69e4-4d33-860f-8dbb01043ade" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.147438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.147591] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.147733] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.181234] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1549.317259] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.317477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.317477] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.317580] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.317679] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.317801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-168faf57-13be-4d1b-8a5c-4618e12dde52" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318518] env[65319]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.319042] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.319268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.319268] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.319421] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.319481] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.319578] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fb71eb3-0fda-4e33-ae51-390153750f63" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.196889] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1551.197383] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.364667] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.365103] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.365726] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.366134] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.738670] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.739098] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.739203] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.739518] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.739849] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.740095] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.740285] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.740559] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.740762] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.741034] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1561.741241] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1561.741417] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1561.741588] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1561.741759] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1561.741943] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1561.742154] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1561.761393] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1561.761562] env[65319]: DEBUG dogpile.cache.region [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1561.761675] env[65319]: DEBUG dogpile.lock [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1561.761845] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "network-929" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.762175] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.762348] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.762469] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.762718] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.762851] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6de0cb-b59e-4eea-a6dd-09c92312f6a5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.265196] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.265478] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.265558] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.265839] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.265987] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.266292] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.266448] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.266562] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.266775] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.266906] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.267198] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.267351] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.267467] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.267666] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.267796] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.267935] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Resource: SegmentPort with ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 is going to be updated. [ 1562.287301] env[65319]: DEBUG networking_nsxv3.common.locking [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.287498] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.287614] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.287862] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.288063] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.288277] env[65319]: DEBUG oslo_concurrency.lockutils [None req-4dee1189-43fb-4d0c-bf89-d3b0c5eef27d None None] Releasing lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.367424] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.367692] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.967664] env[65319]: INFO networking_nsxv3.common.synchronization [req-7f439b36-5da8-4be0-bdf9-3b31d466483b req-c56b94dd-f76b-44eb-b83c-2a0cf7872a06 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1562.967918] env[65319]: INFO networking_nsxv3.common.synchronization [req-7f439b36-5da8-4be0-bdf9-3b31d466483b req-c56b94dd-f76b-44eb-b83c-2a0cf7872a06 service nova] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1562.967998] env[65319]: INFO networking_nsxv3.common.synchronization [req-7f439b36-5da8-4be0-bdf9-3b31d466483b req-c56b94dd-f76b-44eb-b83c-2a0cf7872a06 service nova] Enqueued Resource ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with Priority: HIGHEST for action port [ 1562.968210] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_rules [ 1562.968342] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1562.968436] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with Priority: HIGHEST for action port [ 1562.968966] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.969174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.969174] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.969354] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.969502] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.970221] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.970355] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.970427] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.970642] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.970791] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.970942] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.971014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.971167] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.971246] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.971332] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.972346] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.972444] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.972512] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.972671] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.972757] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d6de0cb-b59e-4eea-a6dd-09c92312f6a5',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.474480] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.475610] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.475743] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.475909] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 with status ACTIVE [ 1563.476153] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.476291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.477203] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.477203] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.477548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.477548] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.477548] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.477724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.477724] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.477789] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.477862] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d6de0cb-b59e-4eea-a6dd-09c92312f6a5 is going to be updated. [ 1563.501155] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.501372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.501372] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.501579] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.501720] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.501873] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d6de0cb-b59e-4eea-a6dd-09c92312f6a5" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.980173] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.482680] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.482894] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.482943] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.483234] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.483321] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.483455] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1564.516856] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.517044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.517090] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.517295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.517440] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.526877] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1566.537797] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1566.538195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.538195] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.538419] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.538619] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.538736] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.538802] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.538954] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.539044] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.539132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.539220] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.041320] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.544088] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8: rpc.has_security_group_logging(os_id): False [ 1567.565182] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.565410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.565410] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.565635] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.565725] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.566050] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.566226] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.566291] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.566473] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.566554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.566646] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1567.629765] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.629990] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.630047] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.630238] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.630413] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.643656] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1567.969464] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.969668] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1569.660554] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1569.660554] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.971590] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.972217] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.973162] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.973520] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.571662] env[65319]: INFO networking_nsxv3.common.synchronization [req-beb9595d-982a-44c6-8752-ef4bbe0cbf6b req-6a922542-f02d-49dc-ac88-30152a9de574 tempest-ServerActionsTestOtherB-941927890 tempest-ServerActionsTestOtherB-941927890-project-member] Enqueued Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1578.572304] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 with Priority: HIGHEST for action security_group_members [ 1578.572618] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.572742] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.572813] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.573014] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.573179] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.573272] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.573639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.573639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.573639] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.573639] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.077575] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.077999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.077999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.077999] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.078182] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.078275] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.078378] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.078439] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.078589] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.078666] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.078752] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 is going to be updated. [ 1579.105591] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.105801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.105801] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.106019] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.106140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.114204] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: IN_PROGRESS for 2s [ 1581.125085] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 in Status: SUCCESS [ 1581.125467] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8 deletion is rescheduled due to dependency. [ 1581.125467] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bf408a4-a7c7-426c-aa6d-3aa92ce6e1a8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.573400] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.573915] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1588.574772] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.575109] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.694267] env[65319]: INFO networking_nsxv3.common.synchronization [None req-7c53e73c-afa8-4590-96f6-b31325ab2312 None None] Enqueued Resource ID: 7d4d4f30-64bf-4b06-b7be-f715d9655725 with Priority: HIGHEST for action port [ 1589.694836] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d4d4f30-64bf-4b06-b7be-f715d9655725 with Priority: HIGHEST for action port [ 1589.695172] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d4d4f30-64bf-4b06-b7be-f715d9655725 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.695294] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d4d4f30-64bf-4b06-b7be-f715d9655725" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.695406] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d4d4f30-64bf-4b06-b7be-f715d9655725" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.698896] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d4d4f30-64bf-4b06-b7be-f715d9655725" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.698896] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d4d4f30-64bf-4b06-b7be-f715d9655725',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.198418] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d4d4f30-64bf-4b06-b7be-f715d9655725 [ 1590.198705] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.198849] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.198918] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.199160] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.199251] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.199935] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d4d4f30-64bf-4b06-b7be-f715d9655725 already deleted. [ 1590.199935] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d4d4f30-64bf-4b06-b7be-f715d9655725" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.743999] env[65319]: INFO networking_nsxv3.common.synchronization [None req-3c1858ef-8667-4b05-a9a3-4c23106f584e None None] Enqueued Resource ID: 09ce4dd6-5bae-4dba-bc42-dcb50fa160a1 with Priority: HIGHEST for action port [ 1591.744542] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ce4dd6-5bae-4dba-bc42-dcb50fa160a1 with Priority: HIGHEST for action port [ 1591.744859] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-09ce4dd6-5bae-4dba-bc42-dcb50fa160a1 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.744982] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09ce4dd6-5bae-4dba-bc42-dcb50fa160a1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.745061] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09ce4dd6-5bae-4dba-bc42-dcb50fa160a1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.745309] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09ce4dd6-5bae-4dba-bc42-dcb50fa160a1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.745401] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ce4dd6-5bae-4dba-bc42-dcb50fa160a1',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.248045] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09ce4dd6-5bae-4dba-bc42-dcb50fa160a1 [ 1592.248301] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.248442] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.248514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.248731] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.248820] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.248917] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09ce4dd6-5bae-4dba-bc42-dcb50fa160a1 already deleted. [ 1592.248997] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09ce4dd6-5bae-4dba-bc42-dcb50fa160a1" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.986891] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7124431-1f92-41c3-bd12-3619d1b82645 req-552c0026-55d0-4001-aef0-b5c06707445d tempest-ServerPasswordTestJSON-2102757183 tempest-ServerPasswordTestJSON-2102757183-project-member] Enqueued Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1594.987465] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1594.987772] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.987897] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.987966] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.988369] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.988535] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.988640] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.988704] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.988859] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.988944] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.989056] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.262846] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.263072] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "network-759" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.263204] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "network-759" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.263534] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "network-759" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.263798] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.263959] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.264347] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.264568] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.264718] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.264924] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1595.265047] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] NeedRegenerationException {{(pid=65319) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1595.265156] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] no value, waiting for create lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1595.265283] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] value creation lock acquired {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1595.265425] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] No value present for key: 'zone-id' {{(pid=65319) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1595.265535] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Calling creation function for not-yet-present value {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1595.265666] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1595.286164] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1595.286327] env[65319]: DEBUG dogpile.cache.region [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65319) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1595.286459] env[65319]: DEBUG dogpile.lock [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Released creation lock {{(pid=65319) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1595.286639] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "network-759" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.286942] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock port-847fe65a-5e00-4a01-ad8a-050aaaf508e8 taken with stack trace [, , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.287132] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.287250] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.287601] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.287747] env[65319]: DEBUG networking_nsxv3.api.rpc [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847fe65a-5e00-4a01-ad8a-050aaaf508e8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.491138] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.491345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.491345] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.491532] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.491658] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.491868] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.491986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.492089] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.492206] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.492295] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.492359] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 already deleted. [ 1595.492437] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.790721] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.791314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.791314] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.791466] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.791506] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.791623] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Segment Port 847fe65a-5e00-4a01-ad8a-050aaaf508e8 not found, creating... [ 1595.791871] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.792588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.792588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.792588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.792588] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.792803] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.792882] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.792995] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.793209] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.793337] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.793504] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Resource: SegmentPort with ID: 847fe65a-5e00-4a01-ad8a-050aaaf508e8 is going to be created. [ 1595.813586] env[65319]: DEBUG networking_nsxv3.common.locking [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.813794] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.814038] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.814194] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.814469] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.814703] env[65319]: DEBUG oslo_concurrency.lockutils [None req-21f4a562-01c5-4620-b685-10ddf622ed6b None None] Releasing lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.496143] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7124431-1f92-41c3-bd12-3619d1b82645 req-bc9f787a-d484-4279-a128-00317532b505 service nova] Enqueued Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_rules [ 1596.496419] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7124431-1f92-41c3-bd12-3619d1b82645 req-bc9f787a-d484-4279-a128-00317532b505 service nova] Enqueued Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1596.496529] env[65319]: INFO networking_nsxv3.common.synchronization [req-a7124431-1f92-41c3-bd12-3619d1b82645 req-bc9f787a-d484-4279-a128-00317532b505 service nova] Enqueued Resource ID: 847fe65a-5e00-4a01-ad8a-050aaaf508e8 with Priority: HIGHEST for action port [ 1596.497058] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_rules [ 1596.497216] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1596.497325] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847fe65a-5e00-4a01-ad8a-050aaaf508e8 with Priority: HIGHEST for action port [ 1596.497626] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock rules-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.497763] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.497842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.498126] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.498221] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.500558] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.500696] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.500808] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.501021] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.501197] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.501302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.501365] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.501975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.501975] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.501975] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.502746] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock port-847fe65a-5e00-4a01-ad8a-050aaaf508e8 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.502746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.502746] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.502907] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.502907] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847fe65a-5e00-4a01-ad8a-050aaaf508e8',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.007734] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.007734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.007734] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 847fe65a-5e00-4a01-ad8a-050aaaf508e8 with status ACTIVE [ 1597.007734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.007734] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.007734] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.008438] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.008438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.008438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.008438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.008438] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.008438] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 847fe65a-5e00-4a01-ad8a-050aaaf508e8 is going to be updated. [ 1597.034380] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.034614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.034614] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.034771] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.034906] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.035352] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847fe65a-5e00-4a01-ad8a-050aaaf508e8" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.510184] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.012895] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.013128] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.013199] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.013381] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.013470] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.013594] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 is going to be created. [ 1598.046901] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.047140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.047140] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.047360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.047522] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.058794] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: UNINITIALIZED for 2s [ 1600.069927] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: SUCCESS [ 1600.070360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.070360] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.070524] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.070723] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.070856] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.070924] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.071097] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.071177] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.071259] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.071346] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1600.573873] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.574141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.574141] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.574281] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.574501] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.574837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.574837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.574837] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.574963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.574963] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.575143] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.575231] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.575284] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.575466] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.575605] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1600.575698] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1600.575758] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1600.575902] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1600.575986] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.576071] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1600.576163] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1601.078087] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 159850ee-8b50-4c99-b3a7-6935e9961c37: rpc.has_security_group_logging(os_id): False [ 1601.099887] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.100112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.100112] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.100302] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.100395] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.100594] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.100695] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.100757] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.100908] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.100987] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.101362] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.101362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.101362] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.101520] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.101568] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.101747] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.101842] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.101901] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.102054] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.102132] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.102218] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 is going to be created. [ 1601.159562] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.159767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.159767] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.159974] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.160173] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.170305] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: IN_PROGRESS for 2s [ 1601.499249] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.499480] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1603.183199] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: SUCCESS [ 1603.183632] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1606.500478] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.500870] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.324411] env[65319]: INFO networking_nsxv3.common.synchronization [req-42a56618-0d11-4706-8619-9dc4e84000ff req-20e0a749-96b4-4b3e-a079-e8107318f9ae tempest-ServerPasswordTestJSON-2102757183 tempest-ServerPasswordTestJSON-2102757183-project-member] Enqueued Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1607.324977] env[65319]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 with Priority: HIGHEST for action security_group_members [ 1607.325268] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock member-159850ee-8b50-4c99-b3a7-6935e9961c37 taken with stack trace [, , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.325919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.325919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.325919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.325919] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.325919] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.326218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.326218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.326218] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.326309] env[65319]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159850ee-8b50-4c99-b3a7-6935e9961c37',) {} {{(pid=65319) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.828993] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.829514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.829514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.829514] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.829728] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.829781] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.829871] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.829931] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.830051] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.830194] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.830194] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 is going to be updated. [ 1607.864051] env[65319]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65319) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1607.864252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1607.864252] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1607.864807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1607.864807] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.873899] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: IN_PROGRESS for 2s [ 1609.885974] env[65319]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 in Status: SUCCESS [ 1609.886359] env[65319]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159850ee-8b50-4c99-b3a7-6935e9961c37 deletion is rescheduled due to dependency. [ 1609.886359] env[65319]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159850ee-8b50-4c99-b3a7-6935e9961c37" {{(pid=65319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.325706] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.326066] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.327471] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.327471] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.328658] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.329073] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.330529] env[65319]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.330928] env[65319]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0